Skip to content

Conversation

taniabogatsch
Copy link
Contributor

@taniabogatsch taniabogatsch commented Jul 31, 2025

Adds two new configs: enable_verification.json and enable_verification_for_debug.

In Main.yml, we run almost all fast tests with verification enabled (release build).
Also, there's an additional nightly debug run now, which runs all fast tests that finish within reasonable time (less than approx. 10s) with verification enabled.

This re-adds a proper debug test run. Also, it'll allow us to eventually remove all manual PRAGMA enable_verification lines from the tests.

I've also added a new relassert build to run some of the configurations: latest storage, force storage, and enable verification. The reasoning is that for these I think it's important to trigger internal assertions.

With that in mind, we also have to consider the following w.r.t. removing PRAGMA enable_verification from more than 2k tests:
- the fast tests will run significantly faster
- but, we no longer run verification passes in a lot of our other CI runs (debug, etc.). Maybe we want to add an additional make debug + enable verification to the nightly run?

@taniabogatsch taniabogatsch marked this pull request as draft July 31, 2025 12:15
@taniabogatsch taniabogatsch marked this pull request as ready for review July 31, 2025 12:27
@taniabogatsch taniabogatsch marked this pull request as draft August 1, 2025 06:40
@taniabogatsch taniabogatsch marked this pull request as ready for review August 1, 2025 07:23
@taniabogatsch taniabogatsch marked this pull request as draft August 1, 2025 09:03
@taniabogatsch taniabogatsch marked this pull request as ready for review August 1, 2025 09:05
@taniabogatsch taniabogatsch marked this pull request as draft August 1, 2025 11:34
@taniabogatsch taniabogatsch marked this pull request as ready for review August 12, 2025 07:28
@taniabogatsch taniabogatsch marked this pull request as draft August 12, 2025 13:35
@taniabogatsch taniabogatsch marked this pull request as ready for review August 13, 2025 11:43
@taniabogatsch
Copy link
Contributor Author

Enable verification runtime with a release build: ~4min
https://github.com/duckdb/duckdb/actions/runs/16936182320/job/47993160477?pr=18467

With a debug build on nightly: ~1h47min - which I think is also really nice, especially because we also re-add running (the majority of) our fast tests with a debug build! :) We did some hacks there in the past when the build started taking too long.

@taniabogatsch
Copy link
Contributor Author

Failing tests are all unrelated.

@taniabogatsch taniabogatsch marked this pull request as ready for review August 17, 2025 09:34
@hannes hannes merged commit 3bcf014 into duckdb:v1.3-ossivalis Aug 18, 2025
53 of 58 checks passed
@taniabogatsch taniabogatsch deleted the enable-verify-config branch August 18, 2025 13:29
Mytherin added a commit that referenced this pull request Aug 19, 2025
Follow-up to #18467. We no longer
need to explicitly set it for each test.
github-actions bot pushed a commit to duckdb/duckdb-r that referenced this pull request Aug 19, 2025
[Fix] Prevent logger deadlock (duckdb/duckdb#18637)
Add enable verification config run (duckdb/duckdb#18467)
bump httpfs (duckdb/duckdb#18591)
Backport renaming a config name `small_block_size.json` to `block_size_16kB` in NightlyTests (duckdb/duckdb#18581)
[Fix] Tidy check ossivalis (duckdb/duckdb#18583)
Add verify fetch row config to Main.yml (duckdb/duckdb#18478)
github-actions bot added a commit to duckdb/duckdb-r that referenced this pull request Aug 19, 2025
[Fix] Prevent logger deadlock (duckdb/duckdb#18637)
Add enable verification config run (duckdb/duckdb#18467)
bump httpfs (duckdb/duckdb#18591)
Backport renaming a config name `small_block_size.json` to `block_size_16kB` in NightlyTests (duckdb/duckdb#18581)
[Fix] Tidy check ossivalis (duckdb/duckdb#18583)
Add verify fetch row config to Main.yml (duckdb/duckdb#18478)

Co-authored-by: krlmlr <krlmlr@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants