-
Notifications
You must be signed in to change notification settings - Fork 2.6k
Add enable verification config run #18467
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add enable verification config run #18467
Conversation
# Conflicts: # test/configs/verify_fetch_row.json
Enable verification runtime with a release build: ~4min With a debug build on nightly: ~1h47min - which I think is also really nice, especially because we also re-add running (the majority of) our fast tests with a debug build! :) We did some hacks there in the past when the build started taking too long. |
Failing tests are all unrelated. |
# Conflicts: # .github/workflows/NightlyTests.yml
[Fix] Prevent logger deadlock (duckdb/duckdb#18637) Add enable verification config run (duckdb/duckdb#18467) bump httpfs (duckdb/duckdb#18591) Backport renaming a config name `small_block_size.json` to `block_size_16kB` in NightlyTests (duckdb/duckdb#18581) [Fix] Tidy check ossivalis (duckdb/duckdb#18583) Add verify fetch row config to Main.yml (duckdb/duckdb#18478)
[Fix] Prevent logger deadlock (duckdb/duckdb#18637) Add enable verification config run (duckdb/duckdb#18467) bump httpfs (duckdb/duckdb#18591) Backport renaming a config name `small_block_size.json` to `block_size_16kB` in NightlyTests (duckdb/duckdb#18581) [Fix] Tidy check ossivalis (duckdb/duckdb#18583) Add verify fetch row config to Main.yml (duckdb/duckdb#18478) Co-authored-by: krlmlr <krlmlr@users.noreply.github.com>
Adds two new configs:
enable_verification.json
andenable_verification_for_debug
.In
Main.yml
, we run almost all fast tests with verification enabled (release
build).Also, there's an additional nightly debug run now, which runs all fast tests that finish within reasonable time (less than approx. 10s) with verification enabled.
This re-adds a proper
debug
test run. Also, it'll allow us to eventually remove all manualPRAGMA enable_verification
lines from the tests.I've also added a newrelassert
build to run some of the configurations: latest storage, force storage, and enable verification. The reasoning is that for these I think it's important to trigger internal assertions.With that in mind, we also have to consider the following w.r.t. removingPRAGMA enable_verification
from more than 2k tests:- the fast tests will run significantly faster- but, we no longer run verification passes in a lot of our other CI runs (debug, etc.). Maybe we want to add an additionalmake debug
+ enable verification to the nightly run?