OrgACRN
/
sof
mirror of https://github.com/thesofproject/sof.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

CI: Travis: disable host-testbench as long as it ignores errors 

See https://github.com/thesofproject/sof/issues/2752

host-testbench.sh exits with success 0 when tests fail. Random, recent, all
green example in PR #2751:

https://travis-ci.org/github/thesofproject/sof/jobs/672996210 is green but:

  eqiir test failed!

I didn't even have to spend time to search for this example, I only
looked at the most recent PR.

Ignoring failures is the very worst type of validation issue because it
makes everyone think everything is OK when it's not. Hides regressions.

Signed-off-by: Marc Herbert <marc.herbert@intel.com>
This commit is contained in:
Marc Herbert 2020-04-09 09:36:27 -07:00 committed by Liam Girdwood
parent 9915b803f7
commit edb2c60054
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
.travis.yml
View File

@ -68,6 +68,9 @@ jobs:
- stage: testbench - stage: testbench
# Disabled for as long as host-testbench.sh ignores failures, see
# https://github.com/thesofproject/sof/issues/2752
if: false
before_install: *docker-pull-sof before_install: *docker-pull-sof
script: script:
- ./scripts/docker-run.sh ./scripts/build-tools.sh -t &> /dev/null - ./scripts/docker-run.sh ./scripts/build-tools.sh -t &> /dev/null