Linux Kernel | EAS Mainline Development

EAS Development for Mainline Linux

EAS development for mainline Linux takes place on LKML and Linaro eas-dev mailing lists where proposed patches are discussed with the community. Arm now provides a pre-integrated version of latest EAS patches for mainline, for upstream development use.
EAS mainline is a moving integration branch tracking tip sched/core, mainline release candidate or linux-pm testing and adding the latest versions of EAS related patch sets targeted at the mainline kernel. The patches may already be under discussion on relevant open source mailing lists or waiting here while their dependencies get resolved and merged upstream.
The integration branch comes as is with synthetic test case testing only. The intention is to have a single branch containing the full EAS picture for mainline Linux kernel developers interested in tracking progress. This EAS mainline integration branch is not suitable for product development. For product, please use the AOSP common kernel.
Source code

EAS mainline integration branches are made available regularly on:
https://gitlab.arm.com/linux-arm/linux-power
The releases are tagged with the date e.g. -20201127 so old integrations are available for comparison
Latest: integration-20210225

Tree: eas/next/integration
Base: eas/next/integration-base
Features:

Misfit improvements for 3-gear (v3 on lkml)
Rework CPU capacity asymmetry detection
(uclamp related) changes in find_energy_efficient_cpu()
Features in Linux mainline:

v4.13 - CPU Invariant Engine (CIE)
v4.15 - Frequency Invariant Engine (FIE)
v4.17 - Idle CPU Per-Entity Load-Tracking (PELT) update
v4.17 - Util(ization) Est(imated)
v4.20 - Misfit task, i.e. forcing migration of running tasks that do not fit on the CPU they are currently running on
v4.20 - Runtime scheduler domain flag detection
v5.0 - Per-cpu Energy Model (EM) and Energy Aware Scheduling (EAS)
v5.3 - Tracepoints (PELT and over-utilzation)
v5.3 - Util(ization) clamping (core and per-task interface)
v5.4 - Util(ization) clamping (cgroup interface)
v5.4 - Patch-set 'sched/fair: Reduce complexity of energy calculation'
v5.5 - Thermal/Cpu Cooling as Energy Model (EM) user
v5.7 - Activity Monitor Unit (AMU) support
v5.8 - Streamline select_task_rq() & select_task_rq_fair() (partly (4/9 patches))
v5.9 - (Devfreq) devices as Energy Model user
v5.9 - SCHED_DEADLINE capacity awareness
v5.10 - Instrument sched domain flags
v5.10 - Cpufreq FIE cleanup
Platforms we test on:

Arm Juno r0 (arm64)
Arm Juno r2 (arm64)
Hikey960 (arm64) (needs out-of-tree patches (hikey960_mainline topic))
DB845C (arm64) (needs out-of-tree patch (db845c_mainline topic))
Qualcomm Robotics RB5 Platform (arm64)
Arm TC2 (arm32)
Next work items:

Pushing Features upstream
100% test pass rate on all platforms
Test Results (integration 20210225)
LISA tests descriptions
(1) juno-r0:

testcase                                        old%   new%  delta%       pvalue fix_iter# 
-------------------------------------------------------------------------------------------
HotplugTorture:test_dmesg                      53.6%   0.0%  -53.6%     2.43e-50           
OneTaskCPUMigration:test_util_task_migration  100.0%  54.4%  -45.6%     8.60e-25           
UtilClamp:test_placement                       24.2%   0.0%  -24.2%     1.26e-15           

test/eas_behaviour (LISA-test) in 0:10:10 [BAD]
    EnergyModelWakeMigration:test_dmesg:          passed    239/239 (100.0%)
    EnergyModelWakeMigration:test_slack:          passed    239/239 (100.0%)
    EnergyModelWakeMigration:test_task_placement: passed    239/239 (100.0%)
    OneSmallTask:test_dmesg:                      passed    239/239 (100.0%)
    OneSmallTask:test_slack:                      passed    239/239 (100.0%)
    OneSmallTask:test_task_placement:             FAILED    2/239   (0.8%)
    RampDown:test_dmesg:                          passed    239/239 (100.0%)
    RampDown:test_slack:                          passed    239/239 (100.0%)
    RampDown:test_task_placement:                 passed    239/239 (100.0%)
    RampUp:test_dmesg:                            passed    239/239 (100.0%)
    RampUp:test_slack:                            FAILED    1/239   (0.4%)
    RampUp:test_task_placement:                   passed    239/239 (100.0%)
    ThreeSmallTasks:test_dmesg:                   passed    239/239 (100.0%)
    ThreeSmallTasks:test_slack:                   passed    239/239 (100.0%)
    ThreeSmallTasks:test_task_placement:          passed    239/239 (100.0%)
    TwoBigTasks:test_dmesg:                       passed    239/239 (100.0%)
    TwoBigTasks:test_slack:                       passed    239/239 (100.0%)
    TwoBigTasks:test_task_placement:              passed    239/239 (100.0%)
    TwoBigThreeSmall:test_dmesg:                  passed    239/239 (100.0%)
    TwoBigThreeSmall:test_slack:                  passed    239/239 (100.0%)
    TwoBigThreeSmall:test_task_placement:         undecided 6/239   (2.5%)
    TwoBigThreeSmall:test_task_placement:         FAILED    2/239   (0.8%)
    
    Error: 0/21, Failed: 3/21, Undecided: 1/21, Skipped: 0/21, Passed: 18/21

test/load_tracking (LISA-test) in 0:33:23 [BAD]
    Invariance:iter_invariance_items[cpu=0@450000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@575000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@575000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@575000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@575000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@575000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@775000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@775000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@775000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@775000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@775000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@850000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@850000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@850000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@850000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=0@850000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@450000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@450000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@450000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@450000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@450000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@625000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@625000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@625000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@625000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@625000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@950000]:test_dmesg:             passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@950000]:test_load_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@950000]:test_load_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@950000]:test_util_behaviour:    passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@950000]:test_util_correctness:  passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_dmesg:            passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_load_behaviour:   passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness: passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_util_behaviour:   passed 239/239 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness: passed 239/239 (100.0%)
    Invariance:test_cpu_invariance:                                        passed 239/239 (100.0%)
    Invariance:test_freq_invariance:                                       passed 239/239 (100.0%)
    Invariance:test_load_behaviour:                                        passed 239/239 (100.0%)
    Invariance:test_load_correctness:                                      passed 239/239 (100.0%)
    Invariance:test_util_behaviour:                                        passed 239/239 (100.0%)
    Invariance:test_util_correctness:                                      passed 239/239 (100.0%)
    NTasksCPUMigration:test_dmesg:                                         passed 239/239 (100.0%)
    NTasksCPUMigration:test_util_task_migration:                           passed 239/239 (100.0%)
    OneTaskCPUMigration:test_dmesg:                                        passed 239/239 (100.0%)
    OneTaskCPUMigration:test_util_task_migration:                          FAILED 130/239 (54.4%)
    TwoTasksCPUMigration:test_dmesg:                                       passed 239/239 (100.0%)
    TwoTasksCPUMigration:test_util_task_migration:                         passed 239/239 (100.0%)
    
    Error: 0/62, Failed: 1/62, Undecided: 0/62, Skipped: 0/62, Passed: 61/62

test/misfit (LISA-test) in 0:02:29 [GOOD]
    StaggeredFinishes:test_dmesg:        passed 239/239 (100.0%)
    StaggeredFinishes:test_preempt_time: passed 239/239 (100.0%)
    StaggeredFinishes:test_throughput:   passed 239/239 (100.0%)
    
    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/util_tracking (LISA-test) in 0:03:01 [BAD]
    UtilConvergence:test_activations: passed 239/239 (100.0%)
    UtilConvergence:test_dmesg:       passed 239/239 (100.0%)
    UtilConvergence:test_means:       FAILED 2/239   (0.8%)
    
    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

test/other (LISA-test) in 0:04:47 [GOOD]
    CapacitySanity:test_capacity_sanity:     passed 239/239 (100.0%)
    UserspaceSanity:test_dmesg:              passed 239/239 (100.0%)
    UserspaceSanity:test_performance_sanity: passed 239/239 (100.0%)
    
    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (LISA-test) in 0:03:28 [BAD]
    UtilClamp:test_dmesg:          passed 239/239 (100.0%)
    UtilClamp:test_freq_selection: FAILED 239/239 (100.0%)
    UtilClamp:test_placement:      passed 239/239 (100.0%)
    
    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

test/hotplug (LISA-test) in 0:02:00 [GOOD]
    HotplugTorture:test_cpus_alive:   passed 239/239 (100.0%)
    HotplugTorture:test_dmesg:        passed 239/239 (100.0%)
    HotplugTorture:test_target_alive: passed 239/239 (100.0%)
    
    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

(2) juno-r2:

testcase                                       old%   new%  delta%       pvalue fix_iter# 
------------------------------------------------------------------------------------------
HotplugTorture:test_dmesg                    100.0%   0.0% -100.0%    1.71e-149           
OneTaskCPUMigration:test_util_task_migration  99.6%  50.8%  -48.8%     2.52e-44           
StaggeredFinishes:test_dmesg                   2.0%   0.0%   -2.0%     6.13e-02           
TwoBigThreeSmall:test_task_placement          20.5%  11.3%   -9.2%     6.70e-03           
UtilClamp:test_placement                      40.8%   0.0%  -40.8%     8.32e-37           

test/eas_behaviour (LISA-test) in 0:09:53 [BAD]
    EnergyModelWakeMigration:test_dmesg:          passed    249/249 (100.0%)
    EnergyModelWakeMigration:test_slack:          passed    249/249 (100.0%)
    EnergyModelWakeMigration:test_task_placement: passed    249/249 (100.0%)
    OneSmallTask:test_dmesg:                      passed    249/249 (100.0%)
    OneSmallTask:test_slack:                      passed    249/249 (100.0%)
    OneSmallTask:test_task_placement:             passed    249/249 (100.0%)
    RampDown:test_dmesg:                          passed    249/249 (100.0%)
    RampDown:test_slack:                          passed    249/249 (100.0%)
    RampDown:test_task_placement:                 passed    249/249 (100.0%)
    RampUp:test_dmesg:                            passed    249/249 (100.0%)
    RampUp:test_slack:                            FAILED    1/249   (0.4%)
    RampUp:test_task_placement:                   passed    249/249 (100.0%)
    ThreeSmallTasks:test_dmesg:                   passed    249/249 (100.0%)
    ThreeSmallTasks:test_slack:                   passed    249/249 (100.0%)
    ThreeSmallTasks:test_task_placement:          passed    249/249 (100.0%)
    TwoBigTasks:test_dmesg:                       passed    249/249 (100.0%)
    TwoBigTasks:test_slack:                       FAILED    1/249   (0.4%)
    TwoBigTasks:test_task_placement:              passed    249/249 (100.0%)
    TwoBigThreeSmall:test_dmesg:                  passed    249/249 (100.0%)
    TwoBigThreeSmall:test_slack:                  passed    249/249 (100.0%)
    TwoBigThreeSmall:test_task_placement:         undecided 1/249   (0.4%)
    TwoBigThreeSmall:test_task_placement:         FAILED    28/249  (11.2%)
    
    Error: 0/21, Failed: 3/21, Undecided: 1/21, Skipped: 0/21, Passed: 18/21

test/load_tracking (LISA-test) in 0:22:59 [BAD]
    Invariance:iter_invariance_items[cpu=0@450000]:test_dmesg:             passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_load_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_util_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_dmesg:             passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_load_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_util_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@950000]:test_dmesg:             passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@950000]:test_load_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@950000]:test_load_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@950000]:test_util_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@950000]:test_util_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_dmesg:             passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_load_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_util_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_load_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_util_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_load_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_util_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:test_cpu_invariance:                                        passed 250/250 (100.0%)
    Invariance:test_freq_invariance:                                       passed 250/250 (100.0%)
    Invariance:test_load_behaviour:                                        passed 250/250 (100.0%)
    Invariance:test_load_correctness:                                      passed 250/250 (100.0%)
    Invariance:test_util_behaviour:                                        passed 250/250 (100.0%)
    Invariance:test_util_correctness:                                      passed 250/250 (100.0%)
    NTasksCPUMigration:test_dmesg:                                         passed 250/250 (100.0%)
    NTasksCPUMigration:test_util_task_migration:                           passed 250/250 (100.0%)
    OneTaskCPUMigration:test_dmesg:                                        passed 250/250 (100.0%)
    OneTaskCPUMigration:test_util_task_migration:                          FAILED 127/250 (50.8%)
    TwoTasksCPUMigration:test_dmesg:                                       passed 250/250 (100.0%)
    TwoTasksCPUMigration:test_util_task_migration:                         passed 250/250 (100.0%)
    
    Error: 0/42, Failed: 1/42, Undecided: 0/42, Skipped: 0/42, Passed: 41/42

test/misfit (LISA-test) in 0:02:27 [GOOD]
    StaggeredFinishes:test_dmesg:        passed 250/250 (100.0%)
    StaggeredFinishes:test_preempt_time: passed 250/250 (100.0%)
    StaggeredFinishes:test_throughput:   passed 250/250 (100.0%)
    
    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/util_tracking (LISA-test) in 0:03:02 [GOOD]
    UtilConvergence:test_activations: passed 250/250 (100.0%)
    UtilConvergence:test_dmesg:       passed 250/250 (100.0%)
    UtilConvergence:test_means:       passed 250/250 (100.0%)
    
    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (LISA-test) in 0:03:45 [GOOD]
    CapacitySanity:test_capacity_sanity:     passed 250/250 (100.0%)
    UserspaceSanity:test_dmesg:              passed 250/250 (100.0%)
    UserspaceSanity:test_performance_sanity: passed 250/250 (100.0%)
    
    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (LISA-test) in 0:03:01 [BAD]
    UtilClamp:test_dmesg:          passed 250/250 (100.0%)
    UtilClamp:test_freq_selection: FAILED 250/250 (100.0%)
    UtilClamp:test_placement:      passed 250/250 (100.0%)
    
    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

test/hotplug (LISA-test) in 0:01:59 [GOOD]
    HotplugTorture:test_cpus_alive:   passed 250/250 (100.0%)
    HotplugTorture:test_dmesg:        passed 250/250 (100.0%)
    HotplugTorture:test_target_alive: passed 250/250 (100.0%)
    
    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

(3) hikey960:

testcase                                                             old%   new%  delta%       pvalue fix_iter#
----------------------------------------------------------------------------------------------------------------
Invariance:iter_invariance_items[cpu=4@1805000]:test_load_behaviour  0.0%   4.4%    4.4%     1.87e-02        73
Invariance:iter_invariance_items[cpu=4@1805000]:test_util_behaviour  0.0%   4.4%    4.4%     1.87e-02        73
Invariance:iter_invariance_items[cpu=4@903000]:test_load_behaviour   1.6%  19.6%   18.0%     1.04e-07        14
Invariance:iter_invariance_items[cpu=4@903000]:test_util_behaviour   1.6%  19.6%   18.0%     1.04e-07        14
Invariance:test_load_behaviour                                       1.6%  24.1%   22.5%     3.75e-10        11
Invariance:test_util_behaviour                                       1.6%  24.1%   22.5%     3.75e-10        11
OneSmallTask:test_task_placement                                     0.0%  70.8%   70.8%     2.37e-48         2
OneTaskCPUMigration:test_util_task_migration                        58.3%   3.2%  -55.1%     2.63e-34
ThreeSmallTasks:test_task_placement                                  0.0%  67.2%   67.2%     1.12e-44         3
TwoBigThreeSmall:test_task_placement                                 0.0%  10.4%   10.4%     1.75e-05        27
UserspaceSanity:test_performance_sanity                              0.0%  32.4%   32.4%     1.95e-17         8
UtilClamp:test_placement                                            16.5%   0.0%  -16.5%     3.66e-11

test/eas_behaviour (LISA-test) in 0:09:13 [BAD]
    EnergyModelWakeMigration:test_dmesg:          passed 250/250 (100.0%)
    EnergyModelWakeMigration:test_slack:          passed 250/250 (100.0%)
    EnergyModelWakeMigration:test_task_placement: passed 250/250 (100.0%)
    OneSmallTask:test_dmesg:                      passed 250/250 (100.0%)
    OneSmallTask:test_slack:                      passed 250/250 (100.0%)
    OneSmallTask:test_task_placement:             FAILED 177/250 (70.8%)
    RampDown:test_dmesg:                          passed 250/250 (100.0%)
    RampDown:test_slack:                          passed 250/250 (100.0%)
    RampDown:test_task_placement:                 passed 250/250 (100.0%)
    RampUp:test_dmesg:                            passed 250/250 (100.0%)
    RampUp:test_slack:                            passed 250/250 (100.0%)
    RampUp:test_task_placement:                   passed 250/250 (100.0%)
    ThreeSmallTasks:test_dmesg:                   passed 250/250 (100.0%)
    ThreeSmallTasks:test_slack:                   passed 250/250 (100.0%)
    ThreeSmallTasks:test_task_placement:          FAILED 168/250 (67.2%)
    TwoBigTasks:test_dmesg:                       passed 250/250 (100.0%)
    TwoBigTasks:test_slack:                       passed 250/250 (100.0%)
    TwoBigTasks:test_task_placement:              passed 250/250 (100.0%)
    TwoBigThreeSmall:test_dmesg:                  passed 250/250 (100.0%)
    TwoBigThreeSmall:test_slack:                  passed 250/250 (100.0%)
    TwoBigThreeSmall:test_task_placement:         FAILED 26/250  (10.4%)

    Error: 0/21, Failed: 3/21, Undecided: 0/21, Skipped: 0/21, Passed: 18/21

test/load_tracking (LISA-test) in 0:31:53 [BAD]
    Invariance:iter_invariance_items[cpu=0@533000]:test_dmesg:             passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@533000]:test_load_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@533000]:test_load_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@533000]:test_util_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@533000]:test_util_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@999000]:test_dmesg:             passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@999000]:test_load_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@999000]:test_load_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@999000]:test_util_behaviour:    passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@999000]:test_util_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1402000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1402000]:test_load_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1402000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1402000]:test_util_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1402000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1709000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1709000]:test_load_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1709000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1709000]:test_util_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1709000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1844000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1844000]:test_load_behaviour:   FAILED 3/250   (1.2%)
    Invariance:iter_invariance_items[cpu=0@1844000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1844000]:test_util_behaviour:   FAILED 3/250   (1.2%)
    Invariance:iter_invariance_items[cpu=0@1844000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@903000]:test_dmesg:             passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@903000]:test_load_behaviour:    FAILED 49/250  (19.6%)
    Invariance:iter_invariance_items[cpu=4@903000]:test_load_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@903000]:test_util_behaviour:    FAILED 49/250  (19.6%)
    Invariance:iter_invariance_items[cpu=4@903000]:test_util_correctness:  passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1421000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1421000]:test_load_behaviour:   FAILED 3/250   (1.2%)
    Invariance:iter_invariance_items[cpu=4@1421000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1421000]:test_util_behaviour:   FAILED 3/250   (1.2%)
    Invariance:iter_invariance_items[cpu=4@1421000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1805000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1805000]:test_load_behaviour:   FAILED 11/249  (4.4%)
    Invariance:iter_invariance_items[cpu=4@1805000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1805000]:test_util_behaviour:   FAILED 11/249  (4.4%)
    Invariance:iter_invariance_items[cpu=4@1805000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2112000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2112000]:test_load_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2112000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2112000]:test_util_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2112000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2362000]:test_dmesg:            passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2362000]:test_load_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2362000]:test_load_correctness: passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2362000]:test_util_behaviour:   passed 250/250 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2362000]:test_util_correctness: passed 250/250 (100.0%)
    Invariance:test_cpu_invariance:                                        FAILED 3/250   (1.2%)
    Invariance:test_freq_invariance:                                       FAILED 1/249   (0.4%)
    Invariance:test_load_behaviour:                                        FAILED 60/249  (24.1%)
    Invariance:test_load_correctness:                                      passed 250/250 (100.0%)
    Invariance:test_util_behaviour:                                        FAILED 60/249  (24.1%)
    Invariance:test_util_correctness:                                      passed 250/250 (100.0%)
    NTasksCPUMigration:test_dmesg:                                         passed 250/250 (100.0%)
    NTasksCPUMigration:test_util_task_migration:                           FAILED 1/250   (0.4%)
    OneTaskCPUMigration:test_dmesg:                                        passed 250/250 (100.0%)
    OneTaskCPUMigration:test_util_task_migration:                          FAILED 8/250   (3.2%)
    TwoTasksCPUMigration:test_dmesg:                                       passed 250/250 (100.0%)
    TwoTasksCPUMigration:test_util_task_migration:                         passed 250/250 (100.0%)

    Error: 0/62, Failed: 14/62, Undecided: 0/62, Skipped: 0/62, Passed: 48/62

test/misfit (LISA-test) in 0:02:21 [GOOD]
    StaggeredFinishes:test_dmesg:        passed 250/250 (100.0%)
    StaggeredFinishes:test_preempt_time: passed 250/250 (100.0%)
    StaggeredFinishes:test_throughput:   passed 250/250 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/util_tracking (LISA-test) in 0:02:54 [BAD]
    UtilConvergence:test_activations: passed 250/250 (100.0%)
    UtilConvergence:test_dmesg:       passed 250/250 (100.0%)
    UtilConvergence:test_means:       FAILED 1/250   (0.4%)

test/other (LISA-test) in 0:04:42 [BAD]
    CapacitySanity:test_capacity_sanity:     passed 250/250 (100.0%)
    UserspaceSanity:test_dmesg:              passed 250/250 (100.0%)
    UserspaceSanity:test_performance_sanity: FAILED 81/250  (32.4%)

    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

test/other (LISA-test) in 0:03:38 [BAD]
    UtilClamp:test_dmesg:          passed 250/250 (100.0%)
    UtilClamp:test_freq_selection: FAILED 250/250 (100.0%)
    UtilClamp:test_placement:      passed 250/250 (100.0%)

    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

(4) TC2:

testcase                  old%   new%  delta%       pvalue fix_iter#
---------------------------------------------------------------------
UtilClamp:test_placement 58.0%   0.0%  -58.0%     2.60e-45

test/eas_behaviour (LISA-test) in 0:08:57 [BAD]
    EnergyModelWakeMigration:test_dmesg:          passed 220/220 (100.0%)
    EnergyModelWakeMigration:test_slack:          passed 220/220 (100.0%)
    EnergyModelWakeMigration:test_task_placement: passed 220/220 (100.0%)
    OneSmallTask:test_dmesg:                      passed 220/220 (100.0%)
    OneSmallTask:test_slack:                      passed 220/220 (100.0%)
    OneSmallTask:test_task_placement:             passed 220/220 (100.0%)
    RampDown:test_dmesg:                          passed 220/220 (100.0%)
    RampDown:test_slack:                          passed 220/220 (100.0%)
    RampDown:test_task_placement:                 passed 220/220 (100.0%)
    RampUp:test_dmesg:                            passed 219/219 (100.0%)
    RampUp:test_slack:                            passed 219/219 (100.0%)
    RampUp:test_task_placement:                   passed 219/219 (100.0%)
    ThreeSmallTasks:test_dmesg:                   passed 219/219 (100.0%)
    ThreeSmallTasks:test_slack:                   passed 219/219 (100.0%)
    ThreeSmallTasks:test_task_placement:          passed 219/219 (100.0%)
    TwoBigTasks:test_dmesg:                       passed 219/219 (100.0%)
    TwoBigTasks:test_slack:                       passed 219/219 (100.0%)
    TwoBigTasks:test_task_placement:              passed 219/219 (100.0%)
    TwoBigThreeSmall:test_dmesg:                  passed 219/219 (100.0%)
    TwoBigThreeSmall:test_slack:                  passed 219/219 (100.0%)
    TwoBigThreeSmall:test_task_placement:         FAILED 5/219   (2.3%)

    Error: 0/21, Failed: 1/21, Undecided: 0/21, Skipped: 0/21, Passed: 20/21

test/load_tracking (LISA-test) in 0:40:12 [BAD]
    Invariance:iter_invariance_items[cpu=0@350000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@350000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@350000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@350000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@350000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@400000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@400000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@400000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@400000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@400000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@500000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@500000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@500000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@500000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@500000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@600000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@600000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@600000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@600000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@600000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@900000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@900000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@900000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@900000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@900000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1000000]:test_dmesg:            passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1000000]:test_load_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1000000]:test_load_correctness: passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1000000]:test_util_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1000000]:test_util_correctness: passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@500000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@500000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@500000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@500000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@500000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@700000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@700000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@700000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@700000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@700000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@900000]:test_dmesg:             passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@900000]:test_load_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@900000]:test_load_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@900000]:test_util_behaviour:    passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@900000]:test_util_correctness:  passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_dmesg:            passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_load_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness: passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_util_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness: passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_dmesg:            passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_load_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness: passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_util_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness: passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_dmesg:            passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_load_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness: passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_util_behaviour:   passed 219/219 (100.0%)
    Invariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness: passed 219/219 (100.0%)
    Invariance:test_cpu_invariance:                                        passed 219/219 (100.0%)
    Invariance:test_freq_invariance:                                       passed 219/219 (100.0%)
    Invariance:test_load_behaviour:                                        passed 219/219 (100.0%)
    Invariance:test_load_correctness:                                      passed 219/219 (100.0%)
    Invariance:test_util_behaviour:                                        passed 219/219 (100.0%)
    Invariance:test_util_correctness:                                      passed 219/219 (100.0%)
    NTasksCPUMigration:test_dmesg:                                         passed 219/219 (100.0%)
    NTasksCPUMigration:test_util_task_migration:                           passed 219/219 (100.0%)
    OneTaskCPUMigration:test_dmesg:                                        passed 219/219 (100.0%)
    OneTaskCPUMigration:test_util_task_migration:                          passed 219/219 (100.0%)
    TwoTasksCPUMigration:test_dmesg:                                       passed 219/219 (100.0%)
    TwoTasksCPUMigration:test_util_task_migration:                         passed 219/219 (100.0%)

    Error: 0/92, Failed: 0/92, Undecided: 0/92, Skipped: 0/92, Passed: 92/92

test/misfit (LISA-test) in 0:02:15 [GOOD]
    StaggeredFinishes:test_dmesg:        passed 220/220 (100.0%)
    StaggeredFinishes:test_preempt_time: passed 220/220 (100.0%)
    StaggeredFinishes:test_throughput:   passed 220/220 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/util_tracking (LISA-test) in 0:02:43 [GOOD]
    UtilConvergence:test_activations: passed 220/220 (100.0%)
    UtilConvergence:test_dmesg:       passed 220/220 (100.0%)
    UtilConvergence:test_means:       passed 220/220 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (LISA-test) in 0:05:44 [GOOD]
    CapacitySanity:test_capacity_sanity:     passed 220/220 (100.0%)
    UserspaceSanity:test_dmesg:              passed 220/220 (100.0%)
    UserspaceSanity:test_performance_sanity: passed 220/220 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (LISA-test) in 0:03:17 [BAD]
    UtilClamp:test_dmesg:          passed 220/220 (100.0%)
    UtilClamp:test_freq_selection: FAILED 220/220 (100.0%)
    UtilClamp:test_placement:      passed 220/220 (100.0%)

    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

test/hotplug (LISA-test) in 0:01:35 [GOOD]
    HotplugTorture:test_cpus_alive:   passed 220/220 (100.0%)
    HotplugTorture:test_dmesg:        passed 220/220 (100.0%)
    HotplugTorture:test_target_alive: passed 220/220 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

(5) db845c:

testcase                                        old%   new%  delta%       pvalue fix_iter#
-------------------------------------------------------------------------------------------
EnergyModelWakeMigration:test_task_placement    0.0% 100.0%  100.0%     6.13e-21         1
HotplugTorture:test_dmesg                     100.0%  97.1%   -2.9%     2.90e-02
OneTaskCPUMigration:test_util_task_migration   89.0%  49.4%  -39.6%     6.43e-16
ThreeSmallTasks:test_task_placement             1.7%  28.2%   26.5%     2.28e-13        10
TwoBigTasks:test_task_placement                 0.0% 100.0%  100.0%     2.40e-09         1
TwoBigThreeSmall:test_task_placement            0.0% 100.0%  100.0%    6.71e-100         1
UtilClamp:test_placement                        7.5%   1.8%   -5.7%     1.85e-02

test/eas_behaviour (LISA-test) in 0:11:45 [BAD]
    EnergyModelWakeMigration:test_dmesg:          passed    170/170 (100.0%)
    EnergyModelWakeMigration:test_slack:          passed    170/170 (100.0%)
    EnergyModelWakeMigration:test_task_placement: undecided 68/170  (40.0%)
    EnergyModelWakeMigration:test_task_placement: FAILED    102/170 (60.0%)
    OneSmallTask:test_dmesg:                      passed    170/170 (100.0%)
    OneSmallTask:test_slack:                      passed    170/170 (100.0%)
    OneSmallTask:test_task_placement:             passed    170/170 (100.0%)
    RampDown:test_dmesg:                          passed    170/170 (100.0%)
    RampDown:test_slack:                          passed    170/170 (100.0%)
    RampDown:test_task_placement:                 undecided 130/170 (76.5%)
    RampUp:test_dmesg:                            passed    170/170 (100.0%)
    RampUp:test_slack:                            passed    170/170 (100.0%)
    RampUp:test_task_placement:                   undecided 115/170 (67.6%)
    ThreeSmallTasks:test_dmesg:                   passed    170/170 (100.0%)
    ThreeSmallTasks:test_slack:                   passed    170/170 (100.0%)
    ThreeSmallTasks:test_task_placement:          FAILED    48/170  (28.2%)
    TwoBigTasks:test_dmesg:                       passed    170/170 (100.0%)
    TwoBigTasks:test_slack:                       passed    170/170 (100.0%)
    TwoBigTasks:test_task_placement:              undecided 146/170 (85.9%)
    TwoBigTasks:test_task_placement:              FAILED    24/170  (14.1%)
    TwoBigThreeSmall:test_dmesg:                  passed    170/170 (100.0%)
    TwoBigThreeSmall:test_slack:                  passed    170/170 (100.0%)
    TwoBigThreeSmall:test_task_placement:         undecided 1/170   (0.6%)
    TwoBigThreeSmall:test_task_placement:         FAILED    169/170 (99.4%)

    Error: 0/21, Failed: 4/21, Undecided: 5/21, Skipped: 0/21, Passed: 15/21

test/load_tracking (LISA-test) in 0:52:25 [BAD]
    Invariance:iter_invariance_items[cpu=0@300000]:test_dmesg:             passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_load_behaviour:    undecided 27/170  (15.9%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_load_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_util_behaviour:    undecided 27/170  (15.9%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_util_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@576000]:test_dmesg:             passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@576000]:test_load_behaviour:    undecided 2/170   (1.2%)
    Invariance:iter_invariance_items[cpu=0@576000]:test_load_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@576000]:test_util_behaviour:    undecided 2/170   (1.2%)
    Invariance:iter_invariance_items[cpu=0@576000]:test_util_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@825600]:test_dmesg:             passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@825600]:test_load_behaviour:    passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@825600]:test_load_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@825600]:test_util_behaviour:    passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@825600]:test_util_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1056000]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1056000]:test_load_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1056000]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1056000]:test_util_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1056000]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1324800]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1324800]:test_load_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1324800]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1324800]:test_util_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1324800]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_load_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_util_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1689600]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1689600]:test_load_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1689600]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1689600]:test_util_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1689600]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1766400]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1766400]:test_load_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1766400]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1766400]:test_util_behaviour:   passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1766400]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@825600]:test_dmesg:             passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@825600]:test_load_behaviour:    undecided 8/170   (4.7%)
    Invariance:iter_invariance_items[cpu=4@825600]:test_load_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@825600]:test_util_behaviour:    undecided 8/170   (4.7%)
    Invariance:iter_invariance_items[cpu=4@825600]:test_util_correctness:  passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1056000]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1056000]:test_load_behaviour:   undecided 18/170  (10.6%)
    Invariance:iter_invariance_items[cpu=4@1056000]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1056000]:test_util_behaviour:   undecided 18/170  (10.6%)
    Invariance:iter_invariance_items[cpu=4@1056000]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1459200]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1459200]:test_load_behaviour:   undecided 15/170  (8.8%)
    Invariance:iter_invariance_items[cpu=4@1459200]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1459200]:test_util_behaviour:   undecided 15/170  (8.8%)
    Invariance:iter_invariance_items[cpu=4@1459200]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1766400]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1766400]:test_load_behaviour:   undecided 10/170  (5.9%)
    Invariance:iter_invariance_items[cpu=4@1766400]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1766400]:test_util_behaviour:   undecided 10/170  (5.9%)
    Invariance:iter_invariance_items[cpu=4@1766400]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1996800]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1996800]:test_load_behaviour:   undecided 11/170  (6.5%)
    Invariance:iter_invariance_items[cpu=4@1996800]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1996800]:test_util_behaviour:   undecided 11/170  (6.5%)
    Invariance:iter_invariance_items[cpu=4@1996800]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2323200]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2323200]:test_load_behaviour:   undecided 4/170   (2.4%)
    Invariance:iter_invariance_items[cpu=4@2323200]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2323200]:test_util_behaviour:   undecided 4/170   (2.4%)
    Invariance:iter_invariance_items[cpu=4@2323200]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2553600]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2553600]:test_load_behaviour:   undecided 11/170  (6.5%)
    Invariance:iter_invariance_items[cpu=4@2553600]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2553600]:test_util_behaviour:   undecided 11/170  (6.5%)
    Invariance:iter_invariance_items[cpu=4@2553600]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2649600]:test_dmesg:            passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2649600]:test_load_behaviour:   undecided 9/170   (5.3%)
    Invariance:iter_invariance_items[cpu=4@2649600]:test_load_correctness: passed    170/170 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2649600]:test_util_behaviour:   undecided 9/170   (5.3%)
    Invariance:iter_invariance_items[cpu=4@2649600]:test_util_correctness: passed    170/170 (100.0%)
    Invariance:test_cpu_invariance:                                        passed    170/170 (100.0%)
    Invariance:test_freq_invariance:                                       passed    170/170 (100.0%)
    Invariance:test_load_behaviour:                                        passed    170/170 (100.0%)
    Invariance:test_load_correctness:                                      passed    170/170 (100.0%)
    Invariance:test_util_behaviour:                                        passed    170/170 (100.0%)
    Invariance:test_util_correctness:                                      passed    170/170 (100.0%)
    NTasksCPUMigration:test_dmesg:                                         passed    170/170 (100.0%)
    NTasksCPUMigration:test_util_task_migration:                           FAILED    1/170   (0.6%)
    OneTaskCPUMigration:test_dmesg:                                        passed    170/170 (100.0%)
    OneTaskCPUMigration:test_util_task_migration:                          FAILED    84/170  (49.4%)
    TwoTasksCPUMigration:test_dmesg:                                       passed    170/170 (100.0%)
    TwoTasksCPUMigration:test_util_task_migration:                         FAILED    2/170   (1.2%)

    Error: 0/92, Failed: 3/92, Undecided: 20/92, Skipped: 0/92, Passed: 69/92

test/misfit (LISA-test) in 0:03:00 [GOOD]
    StaggeredFinishes:test_dmesg:        passed    170/170 (100.0%)
    StaggeredFinishes:test_preempt_time: passed    170/170 (100.0%)
    StaggeredFinishes:test_throughput:   undecided 160/170 (94.1%)

    Error: 0/3, Failed: 0/3, Undecided: 1/3, Skipped: 0/3, Passed: 2/3

test/util_tracking (LISA-test) in 0:03:31 [GOOD]
    UtilConvergence:test_activations: passed 170/170 (100.0%)
    UtilConvergence:test_dmesg:       passed 170/170 (100.0%)
    UtilConvergence:test_means:       passed 170/170 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (LISA-test) in 0:06:30 [BAD]
    CapacitySanity:test_capacity_sanity:     passed 170/170 (100.0%)
    UserspaceSanity:test_dmesg:              passed 170/170 (100.0%)
    UserspaceSanity:test_performance_sanity: FAILED 4/170   (2.4%)

    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

test/other (LISA-test) in 0:04:06 [BAD]
    UtilClamp:test_dmesg:          passed 170/170 (100.0%)
    UtilClamp:test_freq_selection: FAILED 170/170 (100.0%)
    UtilClamp:test_placement:      FAILED 3/170   (1.8%)

    Error: 0/3, Failed: 2/3, Undecided: 0/3, Skipped: 0/3, Passed: 1/3

test/hotplug (LISA-test) in 0:02:33 [BAD]
    HotplugTorture:test_cpus_alive:   passed 170/170 (100.0%)
    HotplugTorture:test_dmesg:        FAILED 165/170 (97.1%)
    HotplugTorture:test_target_alive: passed 170/170 (100.0%)

    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

(6) RB5:

test/eas_behaviour (exekall-LISA-test) in 0:06:17 [BAD]
    EnergyModelWakeMigration:test_dmesg:          passed    206/206 (100.0%)
    EnergyModelWakeMigration:test_slack:          passed    206/206 (100.0%)
    EnergyModelWakeMigration:test_task_placement: passed    206/206 (100.0%)
    OneSmallTask:test_dmesg:                      passed    206/206 (100.0%)
    OneSmallTask:test_slack:                      passed    206/206 (100.0%)
    OneSmallTask:test_task_placement:             undecided 1/206   (0.5%)
    RampDown:test_dmesg:                          passed    206/206 (100.0%)
    RampDown:test_slack:                          passed    206/206 (100.0%)
    RampDown:test_task_placement:                 undecided 2/206   (1.0%)
    RampUp:test_dmesg:                            passed    206/206 (100.0%)
    RampUp:test_slack:                            passed    206/206 (100.0%)
    RampUp:test_task_placement:                   passed    206/206 (100.0%)
    ThreeSmallTasks:test_dmesg:                   passed    206/206 (100.0%)
    ThreeSmallTasks:test_slack:                   passed    206/206 (100.0%)
    ThreeSmallTasks:test_task_placement:          undecided 16/206  (7.8%)
    TwoBigTasks:test_dmesg:                       passed    206/206 (100.0%)
    TwoBigTasks:test_slack:                       passed    206/206 (100.0%)
    TwoBigTasks:test_task_placement:              undecided 9/206   (4.4%)
    TwoBigThreeSmall:test_dmesg:                  passed    206/206 (100.0%)
    TwoBigThreeSmall:test_slack:                  passed    206/206 (100.0%)
    TwoBigThreeSmall:test_task_placement:         undecided 13/206  (6.3%)
    TwoBigThreeSmall:test_task_placement:         FAILED    105/206 (51.0%)

    Error: 0/21, Failed: 1/21, Undecided: 5/21, Skipped: 0/21, Passed: 16/21

test/load_tracking (exekall-LISA-test) in 0:36:02 [BAD]
    Invariance:iter_invariance_items[cpu=0@300000]:test_dmesg:             passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_load_behaviour:    undecided 109/206 (52.9%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_load_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_util_behaviour:    undecided 109/206 (52.9%)
    Invariance:iter_invariance_items[cpu=0@300000]:test_util_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@518400]:test_dmesg:             passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@518400]:test_load_behaviour:    undecided 39/206  (18.9%)
    Invariance:iter_invariance_items[cpu=0@518400]:test_load_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@518400]:test_util_behaviour:    undecided 39/206  (18.9%)
    Invariance:iter_invariance_items[cpu=0@518400]:test_util_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@787200]:test_dmesg:             passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@787200]:test_load_behaviour:    undecided 10/206  (4.9%)
    Invariance:iter_invariance_items[cpu=0@787200]:test_load_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@787200]:test_util_behaviour:    undecided 10/206  (4.9%)
    Invariance:iter_invariance_items[cpu=0@787200]:test_util_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1075200]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1075200]:test_load_behaviour:   undecided 4/205   (2.0%)
    Invariance:iter_invariance_items[cpu=0@1075200]:test_load_correctness: passed    205/205 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1075200]:test_util_behaviour:   undecided 4/205   (2.0%)
    Invariance:iter_invariance_items[cpu=0@1075200]:test_util_correctness: passed    205/205 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1344000]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1344000]:test_load_behaviour:   undecided 1/206   (0.5%)
    Invariance:iter_invariance_items[cpu=0@1344000]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1344000]:test_util_behaviour:   undecided 1/206   (0.5%)
    Invariance:iter_invariance_items[cpu=0@1344000]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_load_behaviour:   undecided 1/206   (0.5%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_util_behaviour:   undecided 1/206   (0.5%)
    Invariance:iter_invariance_items[cpu=0@1516800]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1708800]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1708800]:test_load_behaviour:   passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1708800]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1708800]:test_util_behaviour:   passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1708800]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1804800]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1804800]:test_load_behaviour:   passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1804800]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1804800]:test_util_behaviour:   passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=0@1804800]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@710400]:test_dmesg:             passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@710400]:test_load_behaviour:    undecided 127/206 (61.7%)
    Invariance:iter_invariance_items[cpu=4@710400]:test_load_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@710400]:test_util_behaviour:    undecided 127/206 (61.7%)
    Invariance:iter_invariance_items[cpu=4@710400]:test_util_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@940800]:test_dmesg:             passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@940800]:test_load_behaviour:    undecided 122/206 (59.2%)
    Invariance:iter_invariance_items[cpu=4@940800]:test_load_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@940800]:test_util_behaviour:    undecided 122/206 (59.2%)
    Invariance:iter_invariance_items[cpu=4@940800]:test_util_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1286400]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1286400]:test_load_behaviour:   undecided 103/206 (50.0%)
    Invariance:iter_invariance_items[cpu=4@1286400]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1286400]:test_util_behaviour:   undecided 103/206 (50.0%)
    Invariance:iter_invariance_items[cpu=4@1286400]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1574400]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1574400]:test_load_behaviour:   undecided 119/206 (57.8%)
    Invariance:iter_invariance_items[cpu=4@1574400]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1574400]:test_util_behaviour:   undecided 119/206 (57.8%)
    Invariance:iter_invariance_items[cpu=4@1574400]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1862400]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1862400]:test_load_behaviour:   undecided 103/206 (50.0%)
    Invariance:iter_invariance_items[cpu=4@1862400]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@1862400]:test_util_behaviour:   undecided 103/206 (50.0%)
    Invariance:iter_invariance_items[cpu=4@1862400]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2150400]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2150400]:test_load_behaviour:   undecided 102/206 (49.5%)
    Invariance:iter_invariance_items[cpu=4@2150400]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2150400]:test_util_behaviour:   undecided 102/206 (49.5%)
    Invariance:iter_invariance_items[cpu=4@2150400]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2342400]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2342400]:test_load_behaviour:   undecided 109/206 (52.9%)
    Invariance:iter_invariance_items[cpu=4@2342400]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2342400]:test_util_behaviour:   undecided 109/206 (52.9%)
    Invariance:iter_invariance_items[cpu=4@2342400]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2419200]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2419200]:test_load_behaviour:   undecided 116/206 (56.3%)
    Invariance:iter_invariance_items[cpu=4@2419200]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=4@2419200]:test_util_behaviour:   undecided 116/206 (56.3%)
    Invariance:iter_invariance_items[cpu=4@2419200]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@844800]:test_dmesg:             passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@844800]:test_load_behaviour:    undecided 119/206 (57.8%)
    Invariance:iter_invariance_items[cpu=7@844800]:test_load_behaviour:    FAILED    4/206   (1.9%)
    Invariance:iter_invariance_items[cpu=7@844800]:test_load_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@844800]:test_util_behaviour:    undecided 119/206 (57.8%)
    Invariance:iter_invariance_items[cpu=7@844800]:test_util_behaviour:    FAILED    4/206   (1.9%)
    Invariance:iter_invariance_items[cpu=7@844800]:test_util_correctness:  passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1190400]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1190400]:test_load_behaviour:   undecided 116/206 (56.3%)
    Invariance:iter_invariance_items[cpu=7@1190400]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1190400]:test_util_behaviour:   undecided 116/206 (56.3%)
    Invariance:iter_invariance_items[cpu=7@1190400]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1516800]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1516800]:test_load_behaviour:   undecided 118/206 (57.3%)
    Invariance:iter_invariance_items[cpu=7@1516800]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1516800]:test_util_behaviour:   undecided 118/206 (57.3%)
    Invariance:iter_invariance_items[cpu=7@1516800]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1862400]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1862400]:test_load_behaviour:   undecided 109/206 (52.9%)
    Invariance:iter_invariance_items[cpu=7@1862400]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@1862400]:test_util_behaviour:   undecided 109/206 (52.9%)
    Invariance:iter_invariance_items[cpu=7@1862400]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2169600]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2169600]:test_load_behaviour:   undecided 131/206 (63.6%)
    Invariance:iter_invariance_items[cpu=7@2169600]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2169600]:test_util_behaviour:   undecided 131/206 (63.6%)
    Invariance:iter_invariance_items[cpu=7@2169600]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2553600]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2553600]:test_load_behaviour:   undecided 111/206 (53.9%)
    Invariance:iter_invariance_items[cpu=7@2553600]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2553600]:test_util_behaviour:   undecided 111/206 (53.9%)
    Invariance:iter_invariance_items[cpu=7@2553600]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2745600]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2745600]:test_load_behaviour:   undecided 111/206 (53.9%)
    Invariance:iter_invariance_items[cpu=7@2745600]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2745600]:test_util_behaviour:   undecided 111/206 (53.9%)
    Invariance:iter_invariance_items[cpu=7@2745600]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2841600]:test_dmesg:            passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2841600]:test_load_behaviour:   undecided 112/206 (54.4%)
    Invariance:iter_invariance_items[cpu=7@2841600]:test_load_correctness: passed    206/206 (100.0%)
    Invariance:iter_invariance_items[cpu=7@2841600]:test_util_behaviour:   undecided 112/206 (54.4%)
    Invariance:iter_invariance_items[cpu=7@2841600]:test_util_correctness: passed    206/206 (100.0%)
    Invariance:test_cpu_invariance:                                        passed    206/206 (100.0%)
    Invariance:test_freq_invariance:                                       passed    205/205 (100.0%)
    Invariance:test_load_behaviour:                                        FAILED    4/205   (2.0%)
    Invariance:test_load_correctness:                                      passed    205/205 (100.0%)
    Invariance:test_util_behaviour:                                        FAILED    4/205   (2.0%)
    Invariance:test_util_correctness:                                      passed    205/205 (100.0%)
    NTasksCPUMigration:test_dmesg:                                         passed    206/206 (100.0%)
    NTasksCPUMigration:test_util_task_migration:                           passed    206/206 (100.0%)
    OneTaskCPUMigration:test_dmesg:                                        passed    206/206 (100.0%)
    OneTaskCPUMigration:test_util_task_migration:                          FAILED    206/206 (100.0%)
    TwoTasksCPUMigration:test_dmesg:                                       passed    206/206 (100.0%)
    TwoTasksCPUMigration:test_util_task_migration:                         FAILED    202/206 (98.1%)

    Error: 0/132, Failed: 6/132, Undecided: 44/132, Skipped: 0/132, Passed: 84/132

test/misfit (exekall-LISA-test) in 0:02:24 [GOOD]
    StaggeredFinishes:test_dmesg:        passed    206/206 (100.0%)
    StaggeredFinishes:test_preempt_time: passed    206/206 (100.0%)
    StaggeredFinishes:test_throughput:   undecided 202/206 (98.1%)

    Error: 0/3, Failed: 0/3, Undecided: 1/3, Skipped: 0/3, Passed: 2/3

test/util_tracking (exekall-LISA-test) in 0:02:32 [GOOD]
    UtilConvergence:test_activations: passed 206/206 (100.0%)
    UtilConvergence:test_dmesg:       passed 206/206 (100.0%)
    UtilConvergence:test_means:       passed 206/206 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (exekall-LISA-test) in 0:00:50 [GOOD]
    CapacitySanity:test_capacity_sanity:     passed 206/206 (100.0%)
    UserspaceSanity:test_dmesg:              passed 206/206 (100.0%)
    UserspaceSanity:test_performance_sanity: passed 206/206 (100.0%)

    Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

test/other (exekall-LISA-test) in 0:03:07 [BAD]
    UtilClamp:test_dmesg:          passed 206/206 (100.0%)
    UtilClamp:test_freq_selection: FAILED 206/206 (100.0%)
    UtilClamp:test_placement:      passed 206/206 (100.0%)

    Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

test/hotplug (exekall-LISA-test) in 0:00:23 [BAD]
    HotplugTorture:test_cpus_alive:   passed 206/206 (100.0%)
    HotplugTorture:test_dmesg:        FAILED 168/206 (81.6%)
    HotplugTorture:test_target_alive: passed 206/206 (100.0%)

    Eror: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3