On Mon, 17 Dec 2018 at 11:12, Axel Lebourhis axel.lebourhis@linaro.org wrote:
On Mon, 17 Dec 2018 at 12:01, Milosz Wasilewski milosz.wasilewski@linaro.org wrote:
On Mon, 17 Dec 2018 at 10:58, Axel Lebourhis axel.lebourhis@linaro.org wrote:
Hi all,
At NXP, we would like the result app to report regressions/progressions between 2 tests. We run CTS/VTS job on Android 9, and as we add some features to the OS (DRM for example), we want to make sure we get the expected behavior. For that, we need to know exactly which test cases results are different between the two last jobs. CTS runs about 400 000-500 000 test cases, it's kind of heavy to process manually.
For example, the result table could show 2 tables, one would be the same it is atm, and the other would show the list of test cases results that are different from the previous job.
What do you think about this ? I think this could be useful to everyone.
Axel,
Did you check https://qa-reports.linaro.org/android-lkft/aosp-master-tracking/ ? It's doing exactly what you're asking for. Sources are here: https://github.com/Linaro/squad.
Hi Milosz,
I didn't know about this tool, looks great. So, is it possible to integrate it to my existing LAVA instance ?
yes, sure. Have a look at the docs here: https://squad.readthedocs.io/en/latest/ci.html#id1 There is also a ML for SQUAD here: https://lists.linaro.org/mailman/listinfo/squad-dev
milosz
Regards, Axel
milosz
Should I submit an issue to https://git.lavasoftware.org/lava/lava/ ?
Best regards, Axel
Lava-users mailing list Lava-users@lists.lavasoftware.org https://lists.lavasoftware.org/mailman/listinfo/lava-users