-
Notifications
You must be signed in to change notification settings - Fork 173
CI: Add acceptance tests to new pipeline #3537
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI: Add acceptance tests to new pipeline #3537
Conversation
14202f1
to
6452735
Compare
For now they are fully written in the pipeline.yml but a generator is also added.
fe0f4b6
to
9c87cb8
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewable status: 0 of 7 files reviewed, 1 unresolved discussion (waiting on @lukedirtwalker)
a discussion (no related file):
I don't see how this approach with the generator can be a good solution. There is nothing to enforce consistency.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewable status: 0 of 8 files reviewed, 1 unresolved discussion (waiting on @worxli)
a discussion (no related file):
Previously, worxli (Lukas Bischofberger) wrote…
I don't see how this approach with the generator can be a good solution. There is nothing to enforce consistency.
Done.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 3 of 7 files at r1, 1 of 3 files at r2.
Reviewable status: 4 of 8 files reviewed, 5 unresolved discussions (waiting on @lukedirtwalker and @worxli)
.buildkite/hooks/post-artifact, line 5 at r2 (raw file):
set -eo pipefail rm -rf "bazel-testlogs" "logs" "traces" "gen" "gen-cache"
why the quotes?
.buildkite/hooks/pre-exit, line 3 at r2 (raw file):
#!/bin/bash ./scion.sh topo_clean
I don't think this adds any value here.
.buildkite/hooks/pre-exit, line 13 at r2 (raw file):
docker volume prune -f rm -rf bazel-testlogs logs traces gen gen-cache accept_artifacts
already done in post artifact for most?
.buildkite/pipeline2.sh, line 11 at r2 (raw file):
echo " - label: \"Acceptance: $name\"" echo " command:" echo " - \"rm -rf \$\$ACCEPTANCE_ARTIFACTS\""
when is this necessary?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewable status: 3 of 7 files reviewed, 5 unresolved discussions (waiting on @lukedirtwalker and @worxli)
.buildkite/hooks/post-artifact, line 5 at r2 (raw file):
Previously, worxli (Lukas Bischofberger) wrote…
why the quotes?
Done.
.buildkite/hooks/pre-exit, line 3 at r2 (raw file):
Previously, worxli (Lukas Bischofberger) wrote…
I don't think this adds any value here.
for non-dockerized tests this makes sure that all binaries are gone. Now that prost-artifact doesn't delete the gen
folder it should actually work ;)
.buildkite/hooks/pre-exit, line 13 at r2 (raw file):
Previously, worxli (Lukas Bischofberger) wrote…
already done in post artifact for most?
removed post-artifact
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewable status: 3 of 7 files reviewed, 5 unresolved discussions (waiting on @worxli)
.buildkite/pipeline2.sh, line 11 at r2 (raw file):
Previously, worxli (Lukas Bischofberger) wrote…
when is this necessary?
Hopefully never, removed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 2 of 7 files at r1, 1 of 3 files at r2, 1 of 1 files at r3, 1 of 1 files at r4, 1 of 1 files at r5.
Reviewable status:complete! all files reviewed, all discussions resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 1 of 1 files at r6.
Reviewable status:complete! all files reviewed, all discussions resolved
They are generated by a very simple bash loop.
Also this PR improves the cleanup and makes sure that the environment is clean before executing tests.
This change is