Commit Graph

42 Commits

Author SHA1 Message Date
Kumar Gala c75f8335a8 ci: reduce disk usage for daily build
Avoid some cases of running out of disk space in the daily build.  Add
setting -M option to remove artifacts as we build.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-07-12 16:17:54 -05:00
Kumar Gala 70ad4dc822 ci: Update daily build to use SDK 0.13.0-rc1
Update daily image to docker v0.17.4 to get SDK 0.13.0-rc1 for
testing purposes.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-07-02 10:59:01 -05:00
Erwan Gouriou 91da6d14cb .buildkite: Revert merged temporary change
Revert ".buildkite: Increase timeout + jobs (DNM)"

This reverts commit 773b5d85d0.

Signed-off-by: Erwan Gouriou <erwan.gouriou@linaro.org>
2021-06-16 10:55:17 +02:00
Erwan Gouriou 773b5d85d0 .buildkite: Increase timeout + jobs (DNM)
Increase timeout to allow testing completion on all impacted boards
Slightly Increase jobs as well

Signed-off-by: Erwan Gouriou <erwan.gouriou@linaro.org>
2021-06-16 10:41:01 +02:00
Kumar Gala 6de4241507 ci: Reduce number of workers back to 20
Now that we've past 2.6.0-rc1 reduce number of works back to 20.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-05-10 05:27:27 -05:00
Kumar Gala 56d44705a0 ci: double number of worker for the day
Increase the number of works to help PR throughput as we get
close to code freeze.  Will revert this back after code freeze.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-05-07 09:18:19 -05:00
Kumar Gala 5d97f8ce4c ci: Update to docker image v0.17.1
Update docker image to v0.17.1 to get SDK 0.13.0-alpha-1 to
allow testing of ARC64 as well as the SDK update to gcc-10.3 and
qemu 6.0.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-05-05 17:56:53 -05:00
Anas Nashif c8a2432955 ci: use new docker image based on ubuntu 20.04
Update to new docker image with various updates including renode, llvm
and the base distro (moving from ubuntu 18.04 to 20.04).

Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2021-05-05 11:04:36 -05:00
Kumar Gala bab9ae2ce7 ci: Cleanup files on exit
Remove files to cleanup disk space so if the machine gets
re-used we aren't wasting disk space.  This can happen when different
build types (zephyr, bluetooth, and daily) all happen on the same
machine.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-04-21 08:53:26 -04:00
Kumar Gala 9693fc8fee ci: Handle twister.xml junit files being empty
junitparse doesn't deal well with being given an empty file.  So build
a filterted list of non-empty files to pass to junitparser.

Additionally handle the case that all junit xml files are empty, if
that is the case skip calling junitparser and junit2html.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-04-21 14:31:56 +02:00
Kumar Gala 335c88f4d0 ci: create a merged junit report
Upload a build artifact that is the merged junit report in both xml and
html format.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-04-20 06:55:16 -05:00
Kumar Gala ccbc86eccf ci: Bump to SDK 0.12.4
Bump docker image to pull in SDK 0.12.4 to support split
of arm & arm64.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-03-30 13:14:35 -04:00
Kumar Gala 2dd696f544 sdk: Move to SDK 0.12.3
Update ci and docs to reference SDK 0.12.3.  Update to SDK 0.12.3 as
it includes fixes for support ARM Cortex-M55.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-02-18 11:52:48 -05:00
Kumar Gala 80700039ce ci: restore number of workers
Restore number of workers to previous levels since we've used up
the amazon credits.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-02-01 11:39:29 -05:00
Kumar Gala b9ccae4f04 ci: Bump up number of builds
Still seeing a few timeouts after recently bumping up the number of
builds.  Bump this again to hopefully address the issue for now.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-01-27 13:32:32 -05:00
Kumar Gala 536be8f005 sdk: Move to SDK 0.12.2
Update ci and docs to reference SDK 0.12.2

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-01-25 12:30:49 -05:00
Kumar Gala 4ac2c420f9 ci: Bump up number of builds
To get the daily build to hopefully run completely w/o timeouts lets
increase the number of builders.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-01-23 10:36:55 -06:00
Anas Nashif be00feb6eb ci: switch to 0.12.1 SDK
Move to new SDK.

Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2021-01-20 16:45:31 -05:00
Kumar Gala 49b1f31aed ci: update docker image to v0.11.12
Update to docker image v0.11.12 to get SDK 0.12.1

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-01-18 17:09:22 -05:00
Kumar Gala 7b6fe47691 ci: Update docker image to v0.11.11 for SDK 0.12.0
Update the docker image we build with to grab SDK 0.12.0 in addition to
0.11.4.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2021-01-05 18:58:05 -05:00
Maciej Perkowski 5bb0d9877c ci: Rename leftover Sanitycheck occurances
Rename leftovers in buildkite script

Signed-off-by: Maciej Perkowski <Maciej.Perkowski@nordicsemi.no>
2020-12-14 16:46:44 -05:00
Anas Nashif a05d056943 ci: rename sanitycheck -> twister
Change all CI scripts to use the new script name: twister.

Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2020-12-11 14:13:02 -05:00
Kumar Gala 31cb74936f ci: double number of worker for Dec 2020
Increase the number of workers for Dec as we've got additional credits
to utilize before the end of the year.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-12-03 14:32:16 -05:00
Martí Bolívar 92ecc7866c Revert "BK: Tmp increase number of jobs (DNM)"
This reverts commit 8269a0b9c6.
It was merged by mistake.

Signed-off-by: Martí Bolívar <marti.bolivar@nordicsemi.no>
2020-11-17 07:47:50 -06:00
Ioannis Glaropoulos 3f46b297b3 buildkite: remove workarounds for python package installations
Remove the temporary fixes for installing lpc_checksum
and imgtool packages in buildkite. Not required with
the new docker image.

Signed-off-by: Ioannis Glaropoulos <Ioannis.Glaropoulos@nordicsemi.no>
2020-11-12 15:22:17 -06:00
Ioannis Glaropoulos 6895607360 buildkite: update pipeline to use new dockerfiles release
Update buildkite to use dockerfiles release 0.11.10.
Update both pipeline.yml and daily.yml.

Signed-off-by: Ioannis Glaropoulos <Ioannis.Glaropoulos@nordicsemi.no>
2020-11-12 15:22:17 -06:00
Erwan Gouriou 8269a0b9c6 BK: Tmp increase number of jobs (DNM)
Only to pass CI


Signed-off-by: Erwan Gouriou <erwan.gouriou@linaro.org>
2020-11-03 11:11:04 +01:00
Kumar Gala 1928428f19 ci: Add some disk usage reporting
Add some disk reporting to try and help debug random failures due to
disk space being used up.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-10-26 10:24:13 -05:00
Ioannis Glaropoulos 4ea11f80e9 .buildkite: temporary fix to manually install imgtool
Force CI to manually install imgtool, which is needed
for sanitycheck to build and run the TF-M integration
samples with MCUboot (where MCUboot is built from the
TF-M external project).

Signed-off-by: Ioannis Glaropoulos <Ioannis.Glaropoulos@nordicsemi.no>
2020-10-19 21:08:34 +02:00
Kumar Gala eda6dbe1bc ci: double number of builders for daily build
To get the daily build to hopefully run completely w/o timeouts lets
double the number of builders.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-09-22 14:16:58 -05:00
Anas Nashif 08b3e92662 buildkite: trap errors and do proper cleanup
On errors we were aborting immediately skipping any needed cleanup after
the error has occured. This will run the cleanup function and upload
reports of failure when something bad happens.

Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2020-09-04 20:41:26 +02:00
Martí Bolívar 36aa42f384 ci: retry failed west update
Transient network errors may cause west update to fail. Retry it in
case that happens. Updates for projects which are already up to date
won't hit the network.

Signed-off-by: Martí Bolívar <marti.bolivar@nordicsemi.no>
2020-08-31 09:42:51 -04:00
Anas Nashif a44fa5323f ci: buildkite: exit on errors
Whenever we have an error in the script, exit immediately and avoid
confusing unrelated messages about disk space and such.

Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2020-08-27 21:40:33 -04:00
Kumar Gala a0a3af1a1a ci: Bump timeout for daily build to 3.5 hours
In an attempt to get the daily builds to complete, but the timeout for
them to 3.5 hours.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-08-11 11:08:49 -05:00
Kumar Gala 33056e48c5 ci: make test_file.txt a build artifact for debug
Rather that echo'ng the test_file.txt to the console, lets just upload
it as a buildkite artifact.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-07-30 11:25:25 -04:00
Maxime Bittan 68ef393d25 .buildkite: run.sh: Install lpc_checksum package
The sanitycheck tests are all failing for the lpcxpresso11u68 board
because the lpc_checksum, a new python script requirement introduced
by this board, is not present in the build environment. This
commit attempt to fix this issue by installing lpc_checksum before
running sanitycheck.

Signed-off-by: Maxime Bittan <maxime.bittan@seagate.com>
2020-07-29 20:12:24 +02:00
Erwan Gouriou 60f1d70fa3 buildkite: Increase timeout
Some jobs require more than 120 minutes to complete.
But 180 appears to be long enough.

Signed-off-by: Erwan Gouriou <erwan.gouriou@linaro.org>
2020-07-22 11:02:40 +02:00
Kumar Gala 5dcc6ba529 ci: Add a daily full build workflow
We use a seperate pipeline step and try and reuse the run.sh script with
some minor modifications.  There's a seperate pipeline for this purpose
that does the schedule build.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-06-29 08:11:46 -05:00
Kumar Gala fdab8f189d Revert "buildkite: Add some debug for looking into rebase issue"
This reverts commit 3b5a43e031.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-06-26 15:35:10 -05:00
Kumar Gala 0591191f32 buildkite: Handle case of sanitycheck doing nothing
The junit-annotate step will fail if there are no sanitycheck-*.xml
files to be found which can happen if sanitycheck is run and does
nothing (for example an update to .editorconfig).

Try and create an empty sanitycheck.xml in such a case.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-06-22 18:49:35 +02:00
Kumar Gala 3b5a43e031 buildkite: Add some debug for looking into rebase issue
Add debug ls of .git dir to see at what point we have a
.git/rebase-merge dir around

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-06-09 22:16:57 -05:00
Kumar Gala bea131835d ci: Add initial buildkite ci setup
Add setup to utilize buildkite for CI purposes:

1. .buildkite/hooks/pre-command:
   * Handles getting git checkout setup against upstream repo
   * Setup some west module cache (dirs, clean out files & locks)
   * init dir for ccache

2. .buildkite/hooks/post-command:
   * Report disk usage (meant for possible debugging)

3. .buildkite/pipeline.yml [uses to determine what to do]:
   * setup zephyr env vars
   * set which docker container to use
     (export some local disk caches for git, west modules, and ccache)
   * uses plug to general build annotation on failure (junit-annotate)

4. .buildkite/run.sh [ buildkite wrapper to invoke scripts/ci/run.sh ]

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
2020-06-09 15:28:48 -04:00