Major overhaul to the test suite #1859
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
arm
andriscv
images on arm as it is fastera) so far, it was a convoluted mess from bash scripts building a python test image which used bash scripts to build the docker-image within itself and run the test in this docker-in-docker container
b) now we use
tox
to build the docker-container and run the tests locally/CIc) we have support for all platforms
docker
supportsd) much less code and less convoluted
e) the pytest's
conftest.py
was cleaned up a lotf) one major cause for the random failures we've seen previously on the emulated platforms was due to using
pytest-xdist
and running the tests in parallel - this is removed nowg) another issue I observed was a timing issues, esp. on
RISCV
. Adding some sleep commands before running the test commands fixed those.h) I added a test that compares the value of the
CIPLATFORM
var to the arch reported by FTLSupersedes #1843