EAS Development for Mainline Linux

EAS development for mainline Linux takes place on LKML and Linaro eas-dev mailing lists where proposed patches are discussed with the community. Arm now provides a pre-integrated version of latest EAS patches for mainline, for upstream development use.

EAS mainline is a moving integration branch tracking tip sched/core, mainline release candidate or linux-pm testing and adding the latest versions of EAS related patch sets targeted at the mainline kernel. The patches may already be under discussion on relevant open source mailing lists or waiting here while their dependencies get resolved and merged upstream.

The integration branch comes as is with synthetic test case testing only. The intention is to have a single branch containing the full EAS picture for mainline Linux kernel developers interested in tracking progress. This EAS mainline integration branch is not suitable for product development. For product, please use the AOSP common kernel.

Source code

EAS mainline integration branches are made available regularly on:

        https://gitlab.arm.com/linux-arm/linux-power

The releases are tagged with the date e.g. -20201127 so old integrations are available for comparison

Latest: integration-20210923

Tree: eas/next/integration

Base: eas/next/integration-base

Features:

  1. Inefficient OPPs (v7 on lkml)
  2. arch_topology, ACPI: populate cpu capacity from CPPC (v2 on lkml)

Features in Linux mainline:

  1. v4.13 - CPU Invariant Engine (CIE)
  2. v4.15 - Frequency Invariant Engine (FIE)
  3. v4.17 - Idle CPU Per-Entity Load-Tracking (PELT) update
  4. v4.17 - Util(ization) Est(imated)
  5. v4.20 - Misfit task, i.e. forcing migration of running tasks that do not fit on the CPU they are currently running on
  6. v4.20 - Runtime scheduler domain flag detection
  7. v5.0   - Per-cpu Energy Model (EM) and Energy Aware Scheduling (EAS)
  8. v5.3   - Tracepoints (PELT and over-utilzation)
  9. v5.3   - Util(ization) clamping (core and per-task interface)
  10. v5.4   - Util(ization) clamping (cgroup interface)
  11. v5.4   - Patch-set 'sched/fair: Reduce complexity of energy calculation'
  12. v5.5   - Thermal/Cpu Cooling as Energy Model (EM) user
  13. v5.7   - Activity Monitor Unit (AMU) support
  14. v5.8   - Streamline select_task_rq() & select_task_rq_fair() (partly (4/9 patches))
  15. v5.9   - (Devfreq) devices as Energy Model user
  16. v5.9   - SCHED_DEADLINE capacity awareness
  17. v5.10 - Instrument sched domain flags
  18. v5.10 - Cpufreq FIE cleanup

Platforms we test on:

  1. Arm Juno r0 (arm64)
  2. Arm Juno r2 (arm64)
  3. 96Boards Hikey960 (arm64)
  4. Qualcomm Robotics RB3 (DB845c) (arm64)
  5. Qualcomm Robotics RB5 (QRB5165) (arm64)
  6. Arm TC2 (arm32)

Next work items:

  1. Pushing Features upstream
  2. 100% test pass rate on all platforms

  • Test Results (integration 20210923)

    (1) Juno-r0 (2 Cortex-A57, 4 Cortex-A53)

    testcase                               old%   new%  delta%       pvalue fix_iter#
    ----------------------------------------------------------------------------------
    HotplugRollback:test_hotplug_rollback  8.7%   0.0%   -8.7%     3.98e-05
    OneSmallTask:test_task_placement       8.7%   0.6%   -8.1%     3.59e-04
    UtilConvergence:test_means             0.0%  23.2%   23.2%     6.75e-13        12

    test/eas_behaviour (LISA-test) in 0:10:58 [BAD]
        EnergyModelWakeMigration:test_dmesg:          passed    164/164 (100.0%)
        EnergyModelWakeMigration:test_slack:          passed    164/164 (100.0%)
        EnergyModelWakeMigration:test_task_placement: passed    164/164 (100.0%)
        OneSmallTask:test_dmesg:                      passed    164/164 (100.0%)
        OneSmallTask:test_slack:                      passed    164/164 (100.0%)
        OneSmallTask:test_task_placement:             FAILED    1/164   (0.6%)
        RampDown:test_dmesg:                          passed    164/164 (100.0%)
        RampDown:test_slack:                          passed    164/164 (100.0%)
        RampDown:test_task_placement:                 FAILED    14/164  (8.5%)
        RampUp:test_dmesg:                            passed    164/164 (100.0%)
        RampUp:test_slack:                            passed    164/164 (100.0%)
        RampUp:test_task_placement:                   passed    164/164 (100.0%)
        ThreeSmallTasks:test_dmesg:                   passed    164/164 (100.0%)
        ThreeSmallTasks:test_slack:                   passed    164/164 (100.0%)
        ThreeSmallTasks:test_task_placement:          passed    164/164 (100.0%)
        TwoBigTasks:test_dmesg:                       passed    164/164 (100.0%)
        TwoBigTasks:test_slack:                       passed    164/164 (100.0%)
        TwoBigTasks:test_task_placement:              passed    164/164 (100.0%)
        TwoBigThreeSmall:test_dmesg:                  passed    164/164 (100.0%)
        TwoBigThreeSmall:test_slack:                  passed    164/164 (100.0%)
        TwoBigThreeSmall:test_task_placement:         undecided 5/164   (3.0%)
        TwoBigThreeSmall:test_task_placement:         FAILED    2/164   (1.2%)

        Error: 0/21, Failed: 3/21, Undecided: 1/21, Skipped: 0/21, Passed: 18/21

    test/load_tracking (LISA-test) in 0:42:51 [BAD]
        RqInvariance:iter_invariance_items[cpu=0@450000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@575000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@575000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@575000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@700000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@775000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@775000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@775000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@850000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@850000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@850000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@450000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@450000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@450000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@625000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@625000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@625000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@800000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@950000]:test_dmesg:               passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@950000]:test_load_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@950000]:test_util_correctness:    passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1100000]:test_dmesg:              passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness:   passed 164/164 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness:   passed 164/164 (100.0%)
        RqInvariance:test_load_correctness:                                        passed 164/164 (100.0%)
        RqInvariance:test_util_correctness:                                        passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@575000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@575000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@575000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@575000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@575000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@775000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@775000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@775000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@775000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@775000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@850000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@850000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@850000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@850000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@850000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@450000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@450000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@450000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@450000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@450000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@625000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@625000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@625000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@625000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@625000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_load_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_util_behaviour:    passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@950000]:test_dmesg:             passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@950000]:test_load_behaviour:    FAILED 1/164   (0.6%)
        TaskInvariance:iter_invariance_items[cpu=1@950000]:test_load_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@950000]:test_util_behaviour:    FAILED 1/164   (0.6%)
        TaskInvariance:iter_invariance_items[cpu=1@950000]:test_util_correctness:  passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_dmesg:            passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_load_behaviour:   passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness: passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_util_behaviour:   passed 164/164 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness: passed 164/164 (100.0%)
        TaskInvariance:test_cpu_invariance:                                        passed 164/164 (100.0%)
        TaskInvariance:test_freq_invariance:                                       passed 164/164 (100.0%)
        TaskInvariance:test_load_behaviour:                                        FAILED 1/164   (0.6%)
        TaskInvariance:test_load_correctness:                                      passed 164/164 (100.0%)
        TaskInvariance:test_util_behaviour:                                        FAILED 1/164   (0.6%)
        TaskInvariance:test_util_correctness:                                      passed 164/164 (100.0%)

        Error: 0/88, Failed: 4/88, Undecided: 0/88, Skipped: 0/88, Passed: 84/88

    test/misfit (LISA-test) in 0:02:49 [GOOD]
        StaggeredFinishes:test_dmesg:        passed 164/164 (100.0%)
        StaggeredFinishes:test_preempt_time: passed 164/164 (100.0%)
        StaggeredFinishes:test_throughput:   passed 164/164 (100.0%)

        Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

    test/util_tracking (LISA-test) in 0:04:20 [BAD]
        UtilConvergence:test_activations: passed 164/164 (100.0%)
        UtilConvergence:test_dmesg:       passed 164/164 (100.0%)
        UtilConvergence:test_means:       FAILED 38/164  (23.2%)

        Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

    test/other (LISA-test) in 0:07:02 [GOOD]
        CapacitySanity:test_capacity_sanity:     passed 164/164 (100.0%)
        CapacitySanity:test_dmesg:               passed 164/164 (100.0%)
        UserspaceSanity:test_dmesg:              passed 164/164 (100.0%)
        UserspaceSanity:test_performance_sanity: passed 164/164 (100.0%)

        Error: 0/4, Failed: 0/4, Undecided: 0/4, Skipped: 0/4, Passed: 4/4

    test/other (LISA-test) in 0:13:18 [BAD]
        UtilClamp:test_dmesg:          passed 164/164 (100.0%)
        UtilClamp:test_freq_selection: FAILED 164/164 (100.0%)
        UtilClamp:test_placement:      passed 164/164 (100.0%)

        Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

    test/hotplug (LISA-test) in 0:05:52 [GOOD]
        HotplugRollback:test_dmesg:            passed 164/164 (100.0%)
        HotplugRollback:test_hotplug_rollback: passed 164/164 (100.0%)
        HotplugTorture:test_cpus_alive:        passed 164/164 (100.0%)
        HotplugTorture:test_dmesg:             passed 164/164 (100.0%)
        HotplugTorture:test_target_alive:      passed 164/164 (100.0%)

        Error: 0/5, Failed: 0/5, Undecided: 0/5, Skipped: 0/5, Passed: 5/5

    (2) Juno-r2 (2 Cortex-A72, 4 Cortex-A53)

    testcase                                     old%   new%  delta%       pvalue fix_iter#
    ----------------------------------------------------------------------------------------
    EnergyModelWakeMigration:test_task_placement 5.4%   0.0%   -5.4%     1.88e-04
    HotplugRollback:test_hotplug_rollback        7.2%   0.0%   -7.2%     9.98e-06
    OneSmallTask:test_task_placement             2.7%   0.0%   -2.7%     1.43e-02
    TwoBigThreeSmall:test_task_placement         5.4%   0.9%   -4.5%     6.07e-03

    test/eas_behaviour (LISA-test) in 0:10:53 [BAD]
        EnergyModelWakeMigration:test_dmesg:          passed 227/227 (100.0%)
        EnergyModelWakeMigration:test_slack:          passed 227/227 (100.0%)
        EnergyModelWakeMigration:test_task_placement: passed 227/227 (100.0%)
        OneSmallTask:test_dmesg:                      passed 227/227 (100.0%)
        OneSmallTask:test_slack:                      passed 227/227 (100.0%)
        OneSmallTask:test_task_placement:             passed 227/227 (100.0%)
        RampDown:test_dmesg:                          passed 227/227 (100.0%)
        RampDown:test_slack:                          passed 227/227 (100.0%)
        RampDown:test_task_placement:                 passed 227/227 (100.0%)
        RampUp:test_dmesg:                            passed 227/227 (100.0%)
        RampUp:test_slack:                            passed 227/227 (100.0%)
        RampUp:test_task_placement:                   passed 227/227 (100.0%)
        ThreeSmallTasks:test_dmesg:                   passed 227/227 (100.0%)
        ThreeSmallTasks:test_slack:                   passed 227/227 (100.0%)
        ThreeSmallTasks:test_task_placement:          passed 227/227 (100.0%)
        TwoBigTasks:test_dmesg:                       passed 227/227 (100.0%)
        TwoBigTasks:test_slack:                       passed 227/227 (100.0%)
        TwoBigTasks:test_task_placement:              passed 227/227 (100.0%)
        TwoBigThreeSmall:test_dmesg:                  passed 227/227 (100.0%)
        TwoBigThreeSmall:test_slack:                  passed 227/227 (100.0%)
        TwoBigThreeSmall:test_task_placement:         FAILED 2/227   (0.9%)

        Error: 0/21, Failed: 1/21, Undecided: 0/21, Skipped: 0/21, Passed: 20/21

    test/load_tracking (LISA-test) in 0:26:59 [GOOD]
        RqInvariance:iter_invariance_items[cpu=0@450000]:test_dmesg:               passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@800000]:test_dmesg:               passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@950000]:test_dmesg:               passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@950000]:test_load_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@950000]:test_util_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@600000]:test_dmesg:               passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:    passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1000000]:test_dmesg:              passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness:   passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness:   passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1200000]:test_dmesg:              passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness:   passed 227/227 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness:   passed 227/227 (100.0%)
        RqInvariance:test_load_correctness:                                        passed 227/227 (100.0%)
        RqInvariance:test_util_correctness:                                        passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_dmesg:             passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_load_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_util_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_dmesg:             passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_load_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_util_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@950000]:test_dmesg:             passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@950000]:test_load_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@950000]:test_load_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@950000]:test_util_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@950000]:test_util_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_dmesg:             passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_load_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_util_behaviour:    passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:  passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_dmesg:            passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_load_behaviour:   passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness: passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_util_behaviour:   passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness: passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_dmesg:            passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_load_behaviour:   passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness: passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_util_behaviour:   passed 227/227 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness: passed 227/227 (100.0%)
        TaskInvariance:test_cpu_invariance:                                        passed 227/227 (100.0%)
        TaskInvariance:test_freq_invariance:                                       passed 227/227 (100.0%)
        TaskInvariance:test_load_behaviour:                                        passed 227/227 (100.0%)
        TaskInvariance:test_load_correctness:                                      passed 227/227 (100.0%)
        TaskInvariance:test_util_behaviour:                                        passed 227/227 (100.0%)
        TaskInvariance:test_util_correctness:                                      passed 227/227 (100.0%)

        Error: 0/56, Failed: 0/56, Undecided: 0/56, Skipped: 0/56, Passed: 56/56

    test/misfit (LISA-test) in 0:02:48 [GOOD]
        StaggeredFinishes:test_dmesg:        passed 227/227 (100.0%)
        StaggeredFinishes:test_preempt_time: passed 227/227 (100.0%)
        StaggeredFinishes:test_throughput:   passed 227/227 (100.0%)

        Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

    test/util_tracking (LISA-test) in 0:04:26 [GOOD]
        UtilConvergence:test_activations: passed 227/227 (100.0%)
        UtilConvergence:test_dmesg:       passed 227/227 (100.0%)
        UtilConvergence:test_means:       passed 227/227 (100.0%)

        Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

    test/other (LISA-test) in 0:05:45 [GOOD]
        CapacitySanity:test_capacity_sanity:     passed 227/227 (100.0%)
        CapacitySanity:test_dmesg:               passed 227/227 (100.0%)
        UserspaceSanity:test_dmesg:              passed 227/227 (100.0%)
        UserspaceSanity:test_performance_sanity: passed 227/227 (100.0%)

        Error: 0/4, Failed: 0/4, Undecided: 0/4, Skipped: 0/4, Passed: 4/4

    test/other (LISA-test) in 0:06:11 [BAD]
        UtilClamp:test_dmesg:          passed 227/227 (100.0%)
        UtilClamp:test_freq_selection: FAILED 227/227 (100.0%)
        UtilClamp:test_placement:      passed 227/227 (100.0%)

        Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

    test/hotplug (LISA-test) in 0:05:44 [GOOD]
        HotplugRollback:test_dmesg:            passed 227/227 (100.0%)
        HotplugRollback:test_hotplug_rollback: passed 227/227 (100.0%)
        HotplugTorture:test_cpus_alive:        passed 227/227 (100.0%)
        HotplugTorture:test_dmesg:             passed 227/227 (100.0%)
        HotplugTorture:test_target_alive:      passed 227/227 (100.0%)

        Error: 0/5, Failed: 0/5, Undecided: 0/5, Skipped: 0/5, Passed: 5/5

    (3) Hikey960 (4 Cortex-A73, 4 Cortex-A53)

    testcase                             old%   new%  delta%       pvalue fix_iter#
    --------------------------------------------------------------------------------
    TwoBigThreeSmall:test_task_placement 6.2%  31.8%   25.6%     2.16e-07         8

    test/eas_behaviour (LISA-test) in 0:08:28 [BAD]
        EnergyModelWakeMigration:test_dmesg:          passed 85/85 (100.0%)
        EnergyModelWakeMigration:test_slack:          passed 85/85 (100.0%)
        EnergyModelWakeMigration:test_task_placement: passed 85/85 (100.0%)
        OneSmallTask:test_dmesg:                      passed 85/85 (100.0%)
        OneSmallTask:test_slack:                      passed 85/85 (100.0%)
        OneSmallTask:test_task_placement:             FAILED 2/85  (2.4%)
        RampDown:test_dmesg:                          passed 85/85 (100.0%)
        RampDown:test_slack:                          passed 85/85 (100.0%)
        RampDown:test_task_placement:                 FAILED 65/85 (76.5%)
        RampUp:test_dmesg:                            passed 85/85 (100.0%)
        RampUp:test_slack:                            passed 85/85 (100.0%)
        RampUp:test_task_placement:                   passed 85/85 (100.0%)
        ThreeSmallTasks:test_dmesg:                   passed 85/85 (100.0%)
        ThreeSmallTasks:test_slack:                   passed 85/85 (100.0%)
        ThreeSmallTasks:test_task_placement:          FAILED 33/85 (38.8%)
        TwoBigTasks:test_dmesg:                       passed 85/85 (100.0%)
        TwoBigTasks:test_slack:                       passed 85/85 (100.0%)
        TwoBigTasks:test_task_placement:              passed 85/85 (100.0%)
        TwoBigThreeSmall:test_dmesg:                  passed 85/85 (100.0%)
        TwoBigThreeSmall:test_slack:                  passed 85/85 (100.0%)
        TwoBigThreeSmall:test_task_placement:         FAILED 27/85 (31.8%)

        Error: 0/21, Failed: 4/21, Undecided: 0/21, Skipped: 0/21, Passed: 17/21

    test/load_tracking (LISA-test) in 0:30:51 [GOOD]
        RqInvariance:iter_invariance_items[cpu=0@533000]:test_dmesg:               passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@533000]:test_load_correctness:    passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@533000]:test_util_correctness:    passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@999000]:test_dmesg:               passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@999000]:test_load_correctness:    passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@999000]:test_util_correctness:    passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1402000]:test_dmesg:              passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1402000]:test_load_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1402000]:test_util_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1709000]:test_dmesg:              passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1709000]:test_load_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1709000]:test_util_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1844000]:test_dmesg:              passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1844000]:test_load_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1844000]:test_util_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@903000]:test_dmesg:               passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@903000]:test_load_correctness:    passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@903000]:test_util_correctness:    passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1421000]:test_dmesg:              passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1421000]:test_load_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1421000]:test_util_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1805000]:test_dmesg:              passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1805000]:test_load_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1805000]:test_util_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2112000]:test_dmesg:              passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2112000]:test_load_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2112000]:test_util_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2362000]:test_dmesg:              passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2362000]:test_load_correctness:   passed 85/85 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2362000]:test_util_correctness:   passed 85/85 (100.0%)
        RqInvariance:test_load_correctness:                                        passed 85/85 (100.0%)
        RqInvariance:test_util_correctness:                                        passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@533000]:test_dmesg:             passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@533000]:test_load_behaviour:    passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@533000]:test_load_correctness:  passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@533000]:test_util_behaviour:    passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@533000]:test_util_correctness:  passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@999000]:test_dmesg:             passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@999000]:test_load_behaviour:    passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@999000]:test_load_correctness:  passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@999000]:test_util_behaviour:    passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@999000]:test_util_correctness:  passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1402000]:test_dmesg:            passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1402000]:test_load_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1402000]:test_load_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1402000]:test_util_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1402000]:test_util_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1709000]:test_dmesg:            passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1709000]:test_load_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1709000]:test_load_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1709000]:test_util_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1709000]:test_util_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1844000]:test_dmesg:            passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1844000]:test_load_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1844000]:test_load_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1844000]:test_util_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1844000]:test_util_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@903000]:test_dmesg:             passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@903000]:test_load_behaviour:    passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@903000]:test_load_correctness:  passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@903000]:test_util_behaviour:    passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@903000]:test_util_correctness:  passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1421000]:test_dmesg:            passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1421000]:test_load_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1421000]:test_load_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1421000]:test_util_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1421000]:test_util_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1805000]:test_dmesg:            passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1805000]:test_load_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1805000]:test_load_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1805000]:test_util_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1805000]:test_util_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2112000]:test_dmesg:            passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2112000]:test_load_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2112000]:test_load_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2112000]:test_util_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2112000]:test_util_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2362000]:test_dmesg:            passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2362000]:test_load_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2362000]:test_load_correctness: passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2362000]:test_util_behaviour:   passed 85/85 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2362000]:test_util_correctness: passed 85/85 (100.0%)
        TaskInvariance:test_cpu_invariance:                                        passed 85/85 (100.0%)
        TaskInvariance:test_freq_invariance:                                       passed 85/85 (100.0%)
        TaskInvariance:test_load_behaviour:                                        passed 85/85 (100.0%)
        TaskInvariance:test_load_correctness:                                      passed 85/85 (100.0%)
        TaskInvariance:test_util_behaviour:                                        passed 85/85 (100.0%)
        TaskInvariance:test_util_correctness:                                      passed 85/85 (100.0%)

        Error: 0/88, Failed: 0/88, Undecided: 0/88, Skipped: 0/88, Passed: 88/88

    test/misfit (LISA-test) in 0:02:29 [GOOD]
        StaggeredFinishes:test_dmesg:        passed    84/84 (100.0%)
        StaggeredFinishes:test_preempt_time: passed    84/84 (100.0%)
        StaggeredFinishes:test_throughput:   undecided 9/84  (10.7%)

        Error: 0/3, Failed: 0/3, Undecided: 1/3, Skipped: 0/3, Passed: 2/3

    test/util_tracking (LISA-test) in 0:03:45 [GOOD]
        UtilConvergence:test_activations: passed 84/84 (100.0%)
        UtilConvergence:test_dmesg:       passed 84/84 (100.0%)
        UtilConvergence:test_means:       passed 84/84 (100.0%)

        Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

    test/other (LISA-test) in 0:05:07 [GOOD]
        CapacitySanity:test_capacity_sanity:     passed 84/84 (100.0%)
        CapacitySanity:test_dmesg:               passed 84/84 (100.0%)
        UserspaceSanity:test_dmesg:              passed 84/84 (100.0%)
        UserspaceSanity:test_performance_sanity: passed 84/84 (100.0%)

        Error: 0/4, Failed: 0/4, Undecided: 0/4, Skipped: 0/4, Passed: 4/4

    test/other (LISA-test) in 0:09:13 [BAD]
        UtilClamp:test_dmesg:          passed 84/84 (100.0%)
        UtilClamp:test_freq_selection: FAILED 84/84 (100.0%)
        UtilClamp:test_placement:      passed 84/84 (100.0%)

        Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

    (4) TC2 (2 Cortex-A15, 3 Cortex-A7)

    test/eas_behaviour (LISA-test) in 0:10:38 [BAD]
        EnergyModelWakeMigration:test_dmesg:          passed 119/119 (100.0%)
        EnergyModelWakeMigration:test_slack:          passed 119/119 (100.0%)
        EnergyModelWakeMigration:test_task_placement: passed 119/119 (100.0%)
        OneSmallTask:test_dmesg:                      passed 119/119 (100.0%)
        OneSmallTask:test_slack:                      passed 119/119 (100.0%)
        OneSmallTask:test_task_placement:             passed 119/119 (100.0%)
        RampDown:test_dmesg:                          passed 119/119 (100.0%)
        RampDown:test_slack:                          passed 119/119 (100.0%)
        RampDown:test_task_placement:                 FAILED 10/119  (8.4%)
        RampUp:test_dmesg:                            passed 119/119 (100.0%)
        RampUp:test_slack:                            passed 119/119 (100.0%)
        RampUp:test_task_placement:                   FAILED 119/119 (100.0%)
        ThreeSmallTasks:test_dmesg:                   passed 119/119 (100.0%)
        ThreeSmallTasks:test_slack:                   passed 119/119 (100.0%)
        ThreeSmallTasks:test_task_placement:          passed 119/119 (100.0%)
        TwoBigTasks:test_dmesg:                       passed 119/119 (100.0%)
        TwoBigTasks:test_slack:                       passed 119/119 (100.0%)
        TwoBigTasks:test_task_placement:              passed 119/119 (100.0%)
        TwoBigThreeSmall:test_dmesg:                  passed 119/119 (100.0%)
        TwoBigThreeSmall:test_slack:                  passed 119/119 (100.0%)
        TwoBigThreeSmall:test_task_placement:         FAILED 4/119   (3.4%)

        Error: 0/21, Failed: 3/21, Undecided: 0/21, Skipped: 0/21, Passed: 18/21

    test/load_tracking (LISA-test) in 1:06:01 [GOOD]
        RqInvariance:iter_invariance_items[cpu=0@350000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@350000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@350000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@400000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@400000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@400000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@500000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@500000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@500000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@600000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@600000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@600000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@700000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@800000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@900000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@900000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@900000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1000000]:test_dmesg:              passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1000000]:test_load_correctness:   passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1000000]:test_util_correctness:   passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@500000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@500000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@500000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@600000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@700000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@700000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@700000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@800000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@900000]:test_dmesg:               passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@900000]:test_load_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@900000]:test_util_correctness:    passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1000000]:test_dmesg:              passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness:   passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness:   passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1100000]:test_dmesg:              passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness:   passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness:   passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1200000]:test_dmesg:              passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness:   passed 119/119 (100.0%)
        RqInvariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness:   passed 119/119 (100.0%)
        RqInvariance:test_load_correctness:                                        passed 119/119 (100.0%)
        RqInvariance:test_util_correctness:                                        passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@350000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@350000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@350000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@350000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@350000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@400000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@400000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@400000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@400000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@400000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@500000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@500000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@500000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@500000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@500000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@600000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@600000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@600000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@600000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@600000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@900000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@900000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@900000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@900000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@900000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1000000]:test_dmesg:            passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1000000]:test_load_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1000000]:test_load_correctness: passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1000000]:test_util_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1000000]:test_util_correctness: passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@500000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@500000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@500000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@500000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@500000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@700000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@700000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@700000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@700000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@700000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@900000]:test_dmesg:             passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@900000]:test_load_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@900000]:test_load_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@900000]:test_util_behaviour:    passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@900000]:test_util_correctness:  passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_dmesg:            passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_load_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness: passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_util_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness: passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_dmesg:            passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_load_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness: passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_util_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness: passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_dmesg:            passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_load_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness: passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_util_behaviour:   passed 119/119 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness: passed 119/119 (100.0%)
        TaskInvariance:test_cpu_invariance:                                        passed 119/119 (100.0%)
        TaskInvariance:test_freq_invariance:                                       passed 119/119 (100.0%)
        TaskInvariance:test_load_behaviour:                                        passed 119/119 (100.0%)
        TaskInvariance:test_load_correctness:                                      passed 119/119 (100.0%)
        TaskInvariance:test_util_behaviour:                                        passed 119/119 (100.0%)
        TaskInvariance:test_util_correctness:                                      passed 119/119 (100.0%)

        Error: 0/136, Failed: 0/136, Undecided: 0/136, Skipped: 0/136, Passed: 136/136

    test/misfit (LISA-test) in 0:02:37 [BAD]
        StaggeredFinishes:test_dmesg:        passed 119/119 (100.0%)
        StaggeredFinishes:test_preempt_time: passed 119/119 (100.0%)
        StaggeredFinishes:test_throughput:   FAILED 1/119   (0.8%)

        Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

    test/util_tracking (LISA-test) in 0:04:31 [GOOD]
        UtilConvergence:test_activations: passed 119/119 (100.0%)
        UtilConvergence:test_dmesg:       passed 119/119 (100.0%)
        UtilConvergence:test_means:       passed 119/119 (100.0%)

        Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

    test/other (LISA-test) in 0:08:08 [GOOD]
        CapacitySanity:test_capacity_sanity:     passed 119/119 (100.0%)
        CapacitySanity:test_dmesg:               passed 119/119 (100.0%)
        UserspaceSanity:test_dmesg:              passed 119/119 (100.0%)
        UserspaceSanity:test_performance_sanity: passed 119/119 (100.0%)

        Error: 0/4, Failed: 0/4, Undecided: 0/4, Skipped: 0/4, Passed: 4/4

    test/other (LISA-test) in 0:23:25 [BAD]
        UtilClamp:test_dmesg:          passed 119/119 (100.0%)
        UtilClamp:test_freq_selection: FAILED 119/119 (100.0%)
        UtilClamp:test_placement:      passed 119/119 (100.0%)

        Error: 0/3, Failed: 1/3, Undecided: 0/3, Skipped: 0/3, Passed: 2/3

    test/hotplug (LISA-test) in 0:04:24 [GOOD]
        HotplugRollback:test_dmesg:            passed 119/119 (100.0%)
        HotplugRollback:test_hotplug_rollback: passed 119/119 (100.0%)
        HotplugTorture:test_cpus_alive:        passed 119/119 (100.0%)
        HotplugTorture:test_dmesg:             passed 119/119 (100.0%)
        HotplugTorture:test_target_alive:      passed 119/119 (100.0%)

        Error: 0/5, Failed: 0/5, Undecided: 0/5, Skipped: 0/5, Passed: 5/5

    (5) DB845c (4 Kryo 385 Gold (Cortex-A75), 4 Kryo 385 Silver (Cortex-A55))

    testcase                               old%   new%  delta%       pvalue fix_iter#
    ----------------------------------------------------------------------------------
    HotplugRollback:test_hotplug_rollback 92.5%   0.0%  -92.5%     1.04e-47
    HotplugTorture:test_dmesg              0.0% 100.0%  100.0%     3.36e-59         1

    test/eas_behaviour (LISA-test) in 0:13:01 [BAD]
        EnergyModelWakeMigration:test_dmesg:          passed    93/93 (100.0%)
        EnergyModelWakeMigration:test_slack:          passed    93/93 (100.0%)
        EnergyModelWakeMigration:test_task_placement: undecided 6/93  (6.5%)
        OneSmallTask:test_dmesg:                      passed    93/93 (100.0%)
        OneSmallTask:test_slack:                      passed    93/93 (100.0%)
        OneSmallTask:test_task_placement:             undecided 1/93  (1.1%)
        OneSmallTask:test_task_placement:             FAILED    1/93  (1.1%)
        RampDown:test_dmesg:                          passed    93/93 (100.0%)
        RampDown:test_slack:                          passed    93/93 (100.0%)
        RampDown:test_task_placement:                 FAILED    68/93 (73.1%)
        RampUp:test_dmesg:                            passed    93/93 (100.0%)
        RampUp:test_slack:                            passed    93/93 (100.0%)
        RampUp:test_task_placement:                   passed    93/93 (100.0%)
        ThreeSmallTasks:test_dmesg:                   passed    93/93 (100.0%)
        ThreeSmallTasks:test_slack:                   passed    93/93 (100.0%)
        ThreeSmallTasks:test_task_placement:          passed    93/93 (100.0%)
        TwoBigTasks:test_dmesg:                       passed    93/93 (100.0%)
        TwoBigTasks:test_slack:                       passed    93/93 (100.0%)
        TwoBigTasks:test_task_placement:              undecided 4/93  (4.3%)
        TwoBigThreeSmall:test_dmesg:                  passed    93/93 (100.0%)
        TwoBigThreeSmall:test_slack:                  passed    93/93 (100.0%)
        TwoBigThreeSmall:test_task_placement:         passed    93/93 (100.0%)

        Error: 0/21, Failed: 2/21, Undecided: 3/21, Skipped: 0/21, Passed: 17/21

    test/load_tracking (LISA-test) in 1:17:04 [BAD]
        RqInvariance:iter_invariance_items[cpu=0@300000]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@300000]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@300000]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@576000]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@576000]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@576000]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@825600]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@825600]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@825600]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1056000]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1056000]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1056000]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1324800]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1324800]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1324800]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1516800]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1516800]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1516800]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1689600]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1689600]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1689600]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1766400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1766400]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1766400]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@825600]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@825600]:test_load_correctness:    FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@825600]:test_util_correctness:    FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@1056000]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1056000]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1056000]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1459200]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1459200]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1459200]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1766400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1766400]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1766400]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1996800]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1996800]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1996800]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2323200]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2323200]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2323200]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2553600]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2553600]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2553600]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2649600]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2649600]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2649600]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:test_load_correctness:                                        FAILED    1/93  (1.1%)
        RqInvariance:test_util_correctness:                                        FAILED    1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_load_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_util_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@576000]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@576000]:test_load_behaviour:    passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@576000]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@576000]:test_util_behaviour:    passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@576000]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@825600]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@825600]:test_load_behaviour:    passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@825600]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@825600]:test_util_behaviour:    passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@825600]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1056000]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1056000]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1056000]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1056000]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1056000]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1324800]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1324800]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1324800]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1324800]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1324800]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1689600]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1689600]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1689600]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1689600]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1689600]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1766400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1766400]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1766400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1766400]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1766400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@825600]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@825600]:test_load_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@825600]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@825600]:test_util_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@825600]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1056000]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1056000]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1056000]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1056000]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1056000]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1459200]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1459200]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@1459200]:test_load_correctness: FAILED    1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@1459200]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@1459200]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1766400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1766400]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@1766400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1766400]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@1766400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1996800]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1996800]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1996800]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1996800]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1996800]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2323200]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2323200]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2323200]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2323200]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2323200]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2553600]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2553600]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@2553600]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2553600]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@2553600]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2649600]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2649600]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2649600]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2649600]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2649600]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:test_cpu_invariance:                                        passed    93/93 (100.0%)
        TaskInvariance:test_freq_invariance:                                       passed    93/93 (100.0%)
        TaskInvariance:test_load_behaviour:                                        passed    93/93 (100.0%)
        TaskInvariance:test_load_correctness:                                      FAILED    1/93  (1.1%)
        TaskInvariance:test_util_behaviour:                                        passed    93/93 (100.0%)
        TaskInvariance:test_util_correctness:                                      passed    93/93 (100.0%)

        Error: 0/136, Failed: 6/136, Undecided: 12/136, Skipped: 0/136, Passed: 118/136

    test/misfit (LISA-test) in 0:03:37 [GOOD]
        StaggeredFinishes:test_dmesg:        passed    93/93 (100.0%)
        StaggeredFinishes:test_preempt_time: passed    93/93 (100.0%)
        StaggeredFinishes:test_throughput:   undecided 1/93  (1.1%)

        Error: 0/3, Failed: 0/3, Undecided: 1/3, Skipped: 0/3, Passed: 2/3

    test/util_tracking (LISA-test) in 0:05:10 [GOOD]
        UtilConvergence:test_activations: passed 93/93 (100.0%)
        UtilConvergence:test_dmesg:       passed 93/93 (100.0%)
        UtilConvergence:test_means:       passed 93/93 (100.0%)

        Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

    test/other (LISA-test) in 0:09:04 [BAD]
        CapacitySanity:test_capacity_sanity:     passed 93/93 (100.0%)
        CapacitySanity:test_dmesg:               passed 93/93 (100.0%)
        UserspaceSanity:test_dmesg:              passed 93/93 (100.0%)
        UserspaceSanity:test_performance_sanity: FAILED 2/93  (2.2%)

        Error: 0/4, Failed: 1/4, Undecided: 0/4, Skipped: 0/4, Passed: 3/4

    test/other (LISA-test) in 0:39:06 [BAD]
        UtilClamp:test_dmesg:          passed 93/93 (100.0%)
        UtilClamp:test_freq_selection: FAILED 93/93 (100.0%)
        UtilClamp:test_placement:      FAILED 2/93  (2.2%)

        Error: 0/3, Failed: 2/3, Undecided: 0/3, Skipped: 0/3, Passed: 1/3

    test/hotplug (LISA-test) in 0:06:01 [BAD]
        HotplugRollback:test_dmesg:            passed 93/93 (100.0%)
        HotplugRollback:test_hotplug_rollback: passed 93/93 (100.0%)
        HotplugTorture:test_cpus_alive:        passed 93/93 (100.0%)
        HotplugTorture:test_dmesg:             FAILED 93/93 (100.0%)
        HotplugTorture:test_target_alive:      passed 93/93 (100.0%)

        Error: 0/5, Failed: 1/5, Undecided: 0/5, Skipped: 0/5, Passed: 4/5

     (1 Kryo 585 Prime (Cortex-A77), 3 Kryo 585 Gold (Cortex-A77), 4 Kryo 585 Silver (Cortex-A55))

    testcase                               old%   new%  delta%       pvalue fix_iter#
    ----------------------------------------------------------------------------------
    HotplugRollback:test_hotplug_rollback 34.4%   0.0%  -34.4%     1.84e-11
    HotplugTorture:test_dmesg              0.0% 100.0%  100.0%     3.49e-55         1

    test/eas_behaviour (LISA-test) in 0:10:44 [BAD]
        EnergyModelWakeMigration:test_dmesg:          passed    93/93 (100.0%)
        EnergyModelWakeMigration:test_slack:          passed    93/93 (100.0%)
        EnergyModelWakeMigration:test_task_placement: undecided 2/93  (2.2%)
        OneSmallTask:test_dmesg:                      passed    93/93 (100.0%)
        OneSmallTask:test_slack:                      passed    93/93 (100.0%)
        OneSmallTask:test_task_placement:             undecided 1/93  (1.1%)
        OneSmallTask:test_task_placement:             FAILED    2/93  (2.2%)
        RampDown:test_dmesg:                          passed    93/93 (100.0%)
        RampDown:test_slack:                          passed    93/93 (100.0%)
        RampDown:test_task_placement:                 undecided 6/93  (6.5%)
        RampUp:test_dmesg:                            passed    93/93 (100.0%)
        RampUp:test_slack:                            passed    93/93 (100.0%)
        RampUp:test_task_placement:                   undecided 4/93  (4.3%)
        ThreeSmallTasks:test_dmesg:                   passed    93/93 (100.0%)
        ThreeSmallTasks:test_slack:                   passed    93/93 (100.0%)
        ThreeSmallTasks:test_task_placement:          passed    93/93 (100.0%)
        TwoBigTasks:test_dmesg:                       passed    93/93 (100.0%)
        TwoBigTasks:test_slack:                       skipped   93/93 (100.0%)
        TwoBigTasks:test_task_placement:              skipped   93/93 (100.0%)
        TwoBigThreeSmall:test_dmesg:                  passed    93/93 (100.0%)
        TwoBigThreeSmall:test_slack:                  skipped   93/93 (100.0%)
        TwoBigThreeSmall:test_task_placement:         skipped   93/93 (100.0%)

        Error: 0/21, Failed: 1/21, Undecided: 4/21, Skipped: 4/21, Passed: 13/21

    test/load_tracking (LISA-test) in 1:51:33 [BAD]
        RqInvariance:iter_invariance_items[cpu=0@300000]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@300000]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@300000]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@518400]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@518400]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@518400]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@787200]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@787200]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@787200]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1075200]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1075200]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1075200]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1344000]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1344000]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1344000]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1516800]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1516800]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1516800]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1708800]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1708800]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1708800]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1804800]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1804800]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=0@1804800]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@710400]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@710400]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@710400]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@940800]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@940800]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@940800]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1286400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1286400]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1286400]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1574400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1574400]:test_load_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@1574400]:test_util_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@1862400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@1862400]:test_load_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@1862400]:test_util_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@2150400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2150400]:test_load_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@2150400]:test_util_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@2342400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2342400]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2342400]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2419200]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=4@2419200]:test_load_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=4@2419200]:test_util_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=7@844800]:test_dmesg:               passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@844800]:test_load_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@844800]:test_util_correctness:    passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@1190400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@1190400]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@1190400]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@1516800]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@1516800]:test_load_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=7@1516800]:test_util_correctness:   FAILED    1/93  (1.1%)
        RqInvariance:iter_invariance_items[cpu=7@1862400]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@1862400]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@1862400]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2169600]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2169600]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2169600]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2553600]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2553600]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2553600]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2745600]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2745600]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2745600]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2841600]:test_dmesg:              passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2841600]:test_load_correctness:   passed    93/93 (100.0%)
        RqInvariance:iter_invariance_items[cpu=7@2841600]:test_util_correctness:   passed    93/93 (100.0%)
        RqInvariance:test_load_correctness:                                        FAILED    5/93  (5.4%)
        RqInvariance:test_util_correctness:                                        FAILED    5/93  (5.4%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_load_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_util_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@300000]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@518400]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@518400]:test_load_behaviour:    undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=0@518400]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@518400]:test_util_behaviour:    undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=0@518400]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@787200]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@787200]:test_load_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@787200]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@787200]:test_util_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@787200]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1075200]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1075200]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1075200]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1075200]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1075200]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1344000]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1344000]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1344000]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1344000]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1344000]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1516800]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1708800]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1708800]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1708800]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1708800]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=0@1708800]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1804800]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1804800]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1804800]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1804800]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=0@1804800]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@710400]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@710400]:test_load_behaviour:    undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=4@710400]:test_load_correctness:  FAILED    1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@710400]:test_util_behaviour:    undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=4@710400]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@940800]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@940800]:test_load_behaviour:    passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@940800]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@940800]:test_util_behaviour:    passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@940800]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1286400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1286400]:test_load_behaviour:   undecided 3/93  (3.2%)
        TaskInvariance:iter_invariance_items[cpu=4@1286400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1286400]:test_util_behaviour:   undecided 3/93  (3.2%)
        TaskInvariance:iter_invariance_items[cpu=4@1286400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1574400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1574400]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@1574400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1574400]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@1574400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1862400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1862400]:test_load_behaviour:   undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=4@1862400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@1862400]:test_util_behaviour:   undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=4@1862400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2150400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2150400]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2150400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2150400]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2150400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2342400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2342400]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@2342400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2342400]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@2342400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2419200]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2419200]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@2419200]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=4@2419200]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=4@2419200]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@844800]:test_dmesg:             passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@844800]:test_load_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=7@844800]:test_load_behaviour:    FAILED    2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=7@844800]:test_load_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@844800]:test_util_behaviour:    undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=7@844800]:test_util_behaviour:    FAILED    2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=7@844800]:test_util_correctness:  passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1190400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1190400]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1190400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1190400]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1190400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1516800]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1516800]:test_load_behaviour:   undecided 3/93  (3.2%)
        TaskInvariance:iter_invariance_items[cpu=7@1516800]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1516800]:test_util_behaviour:   undecided 3/93  (3.2%)
        TaskInvariance:iter_invariance_items[cpu=7@1516800]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1862400]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1862400]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1862400]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1862400]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@1862400]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2169600]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2169600]:test_load_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2169600]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2169600]:test_util_behaviour:   passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2169600]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2553600]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2553600]:test_load_behaviour:   undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=7@2553600]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2553600]:test_util_behaviour:   undecided 2/93  (2.2%)
        TaskInvariance:iter_invariance_items[cpu=7@2553600]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2745600]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2745600]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=7@2745600]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2745600]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=7@2745600]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2841600]:test_dmesg:            passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2841600]:test_load_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=7@2841600]:test_load_correctness: passed    93/93 (100.0%)
        TaskInvariance:iter_invariance_items[cpu=7@2841600]:test_util_behaviour:   undecided 1/93  (1.1%)
        TaskInvariance:iter_invariance_items[cpu=7@2841600]:test_util_correctness: passed    93/93 (100.0%)
        TaskInvariance:test_cpu_invariance:                                        passed    93/93 (100.0%)
        TaskInvariance:test_freq_invariance:                                       passed    93/93 (100.0%)
        TaskInvariance:test_load_behaviour:                                        FAILED    2/93  (2.2%)
        TaskInvariance:test_load_correctness:                                      FAILED    1/93  (1.1%)
        TaskInvariance:test_util_behaviour:                                        FAILED    2/93  (2.2%)
        TaskInvariance:test_util_correctness:                                      passed    93/93 (100.0%)

        Error: 0/200, Failed: 18/200, Undecided: 36/200, Skipped: 0/200, Passed: 148/200

    test/misfit (LISA-test) in 0:03:24 [GOOD]
        StaggeredFinishes:test_dmesg:        passed    93/93 (100.0%)
        StaggeredFinishes:test_preempt_time: passed    93/93 (100.0%)
        StaggeredFinishes:test_throughput:   undecided 5/93  (5.4%)

        Error: 0/3, Failed: 0/3, Undecided: 1/3, Skipped: 0/3, Passed: 2/3

    test/util_tracking (LISA-test) in 0:04:48 [GOOD]
        UtilConvergence:test_activations: passed 93/93 (100.0%)
        UtilConvergence:test_dmesg:       passed 93/93 (100.0%)
        UtilConvergence:test_means:       passed 93/93 (100.0%)

        Error: 0/3, Failed: 0/3, Undecided: 0/3, Skipped: 0/3, Passed: 3/3

    test/other (LISA-test) in 0:10:32 [GOOD]
        CapacitySanity:test_capacity_sanity:     passed 93/93 (100.0%)
        CapacitySanity:test_dmesg:               passed 93/93 (100.0%)
        UserspaceSanity:test_dmesg:              passed 93/93 (100.0%)
        UserspaceSanity:test_performance_sanity: passed 93/93 (100.0%)

        Error: 0/4, Failed: 0/4, Undecided: 0/4, Skipped: 0/4, Passed: 4/4

    test/other (LISA-test) in 0:06:47 [BAD]
        UtilClamp:test_dmesg:          passed 93/93 (100.0%)
        UtilClamp:test_freq_selection: FAILED 22/74 (29.7%)
        UtilClamp:test_placement:      FAILED 76/93 (81.7%)

        Error: 0/3, Failed: 2/3, Undecided: 0/3, Skipped: 0/3, Passed: 1/3

    test/hotplug (LISA-test) in 0:05:15 [BAD]
        HotplugRollback:test_dmesg:            passed 93/93 (100.0%)
        HotplugRollback:test_hotplug_rollback: passed 93/93 (100.0%)
        HotplugTorture:test_cpus_alive:        passed 93/93 (100.0%)
        HotplugTorture:test_dmesg:             FAILED 93/93 (100.0%)
        HotplugTorture:test_target_alive:      passed 93/93 (100.0%)

        Error: 0/5, Failed: 1/5, Undecided: 0/5, Skipped: 0/5, Passed: 4/5