Skip to content

Delete transaction_mutex in store #7311

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Apr 15, 2025
Merged

Delete transaction_mutex in store #7311

merged 4 commits into from
Apr 15, 2025

Conversation

hopinheimer
Copy link
Member

@hopinheimer hopinheimer commented Apr 10, 2025 •
edited by dapplion
Loading

addresses #7270

Rationale on why it is okay to delete it can be found in

@michaelsproul
Copy link
Member

Couple more unused imports that need fixing (hint: run make lint-full locally, it's quite fast)

@michaelsproul michaelsproul added waiting-on-author The reviewer has suggested changes and awaits thier implementation. tree-states Ongoing state and database overhaul labels Apr 11, 2025
michaelsproul
michaelsproul approved these changes Apr 15, 2025
View reviewed changes
Copy link
Member

@michaelsproul michaelsproul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks!

@michaelsproul michaelsproul merged commit 00fbd82 into sigp:tree-states-hot-rebase Apr 15, 2025
28 of 29 checks passed
@michaelsproul michaelsproul removed the waiting-on-author The reviewer has suggested changes and awaits thier implementation. label Apr 15, 2025
@chong-he chong-he mentioned this pull request Apr 28, 2025
Closed
michaelsproul added a commit that referenced this pull request Jun 16, 2025
@michaelsproul
Hierarchical state diffs in hot DB (#6750)
1cf4098 
Squashed commit of the following:

commit 629fa73
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Sat Jun 14 12:58:45 2025 +1000

    Tweak hdiff size metric buckets

commit 9c8e58c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Jun 13 17:16:27 2025 +1000

    Metric for hdiff sizes

commit 707557a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Jun 11 15:36:18 2025 +1000

    Clean up hdiff timing metrics

commit 22f7f73
Merge: 9e77f82 8c6abc0
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Jun 11 14:36:04 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 9e77f82
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Jun 2 17:31:17 2025 +1000

    Remove FIXMEs/mess

commit 4913987
Merge: 80a5353 ae30480
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Jun 2 17:13:35 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 80a5353
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 17:28:49 2025 +1000

    Remove some stale FIXMEs/typos

commit bb23f2a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 16:30:35 2025 +1000

    Add a new test and fix split loading

commit 6094e23
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 15:50:45 2025 +1000

    Clean up test assert

commit 06c2632
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 15:33:46 2025 +1000

    Typo fix

commit 064115c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 13:49:25 2025 +1000

    Fix DB manager downgrade

commit 03fece6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 12:35:37 2025 +1000

    Skip migrating pre-split states in downgrade

commit f0823fe
Merge: bc47fd6 0ddf9a9
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 09:12:39 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit bc47fd6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 16:50:24 2025 +1000

    Avoid putting pre-split states in the state cache

commit 5fb55be
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 15:38:50 2025 +1000

    Fix migration of dense diffs

commit 9acb1cf
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 13:27:37 2025 +1000

    Fix one schema test and add a new one that's broken :sunglasses:

commit 78d0496
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 10:56:45 2025 +1000

    Rework store config and compatibility checks

commit 8ebe1b2
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 27 17:02:49 2025 +1000

    Add test for get_ancestor_state_root

commit b0191db
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 26 17:50:34 2025 +1000

    Fix split slot migration

commit 9800ab8
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 26 16:34:05 2025 +1000

    Attempt to fix archive node V24 upgrade

commit 2485beb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 22 17:03:06 2025 +1000

    Add logging for downgrade

commit d045796
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 22 11:10:46 2025 +1000

    Align hot grid to freezer when migrating archive nodes

commit 444c1cd
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 21 15:23:11 2025 +1000

    Add a test for states retained for hot diffs

commit 5d8ddb6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 21 12:22:00 2025 +1000

    Delete temporary states on migration

commit a4f442c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 17:47:53 2025 +1000

    Clean up some more TODOs

commit c39daf2
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 17:41:31 2025 +1000

    Correct V23 -> V24 in load_split comment

commit c12dd1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 16:05:57 2025 +1000

    Split hdiff metrics by hot/cold

commit 1096565
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:27:04 2025 +1000

    Move legacy state storage code into migration file

commit 6887ad7
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:14:00 2025 +1000

    Tweak comments in v24 migration

commit b73cb1e
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:03:24 2025 +1000

    Finish PruningCheckpoint thing

commit b681648
Merge: f83b083 23ad833
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 16:28:40 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit f83b083
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 16:27:03 2025 +1000

    WIP remove pruning checkpoint

commit 00ef82a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 12:43:10 2025 +1000

    Update comment/remove TODO

commit c74913f
Merge: 7d8343f 851ee2b
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 15 11:02:40 2025 +1000

    Merge branch 'unstable' into tree-states-hot-rebase

commit 7d8343f
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 8 14:59:10 2025 +1000

    Use same hierarchy for hot and cold

    This is nice as it enables us to avoid recomputing diffs, we can just copy.

commit e1475a1
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 8 14:43:34 2025 +1000

    Prevent split from changing during ancestor calc

commit 8fa3665
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 1 13:20:44 2025 +1000

    Remove non-contiguous DAG checks

commit 54ded28
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Apr 30 09:48:10 2025 +1000

    Use 0u8 inside DiffBaseState::Snapshot

commit 1184d72
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 29 19:20:53 2025 +1000

    More type-safe diff base state

commit 088cfa0
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 29 18:32:21 2025 +1000

    Simplify migration logic

commit fcbec47
Merge: 00fbd82 476f3a5
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 15 11:05:18 2025 +1000

    Merge branch 'unstable' into tree-states-hot-rebase

commit 00fbd82
Author: hopinheimer <48147533+hopinheimer@users.noreply.github.com>
Date:   Mon Apr 14 21:04:53 2025 -0400

    Delete `transaction_mutex` in store (#7311)

    * remove  from db

    * remove dependent code

    * clippy happy

    * fixing clippy issues

commit 990ba80
Merge: f70e543 d96b731
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 14:36:43 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit f70e543
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 13:14:58 2025 +1000

    Fix anchor archives

commit 8657b08
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 12:46:21 2025 +1000

    Add note about multiple DAG roots

commit 74ebf8b
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Apr 7 17:04:36 2025 +1000

    Fix clippy and tests

commit fcc96a1
Merge: 9151436 70850fe
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Apr 7 17:00:29 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 9151436
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 3 13:54:31 2025 +1100

    Fix test OOM issues on tree-states-hot (#7176)

    * Try rebasing

    * Heaptrack

    * Try to prevent and detect circular references

    * Don't use StateRootsIterator in get_ancestor_state_root

    * Skip one slot in get_ancestor_state_root

    * Heaptrack clippy fix

    * Fix store test

    * Log diff base state root

    * Jump by slots per historical vector

    * Maybe ok fix for test

    * get_ancestor_state_root

    * lint

    * Implement downgrade from v24

    * Better on state write

    * Log on ws test chain dump

    * Fix WSS tests

    * Tweak condition

    * Revert "Heaptrack"

    This reverts commit f69c38c.

    * Reduce diff

    * Use debug repr

    * Spelling

    ---------

    Co-authored-by: dapplion <35266934+dapplion@users.noreply.github.com>

commit b49272f
Merge: 1c81c93 a322463
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 18 15:58:59 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit a322463
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 18 15:53:20 2025 +1100

    Fix compilation

commit f4dd6fe
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Mar 17 14:56:15 2025 -0300

    Clean up temporary flags on migration

commit 1c81c93
Merge: 5b8680a 11cfa1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 17:00:39 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit 11cfa1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 15:47:58 2025 +1100

    Purge temporary states more, fixing bug

commit 5b8680a
Merge: 9f36dc8 b43c071
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 14:51:20 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit 9f36dc8
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 04:34:01 2025 -0300

    Don't include massive lists in errors

commit a1b45e6
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 04:33:25 2025 -0300

    Persist states even if in cache

commit b43c071
Merge: a613662 d60c24e
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 11:31:48 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit a928d30
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 16:49:37 2025 +1100

    Fix merge snafu

commit 3f23942
Merge: 4e74ed1 a613662
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 15:56:37 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit a613662
Merge: ebd05c7 1916a2a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 15:15:04 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit ebd05c7
Merge: d58d8ef b4e79ed
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Mar 10 18:08:37 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit 4e74ed1
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 02:12:12 2025 -0300

    Fix wrapping sub

commit ceb59e3
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 01:32:51 2025 -0300

    Don't log extra diffs as roots

commit f020adb
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 01:05:33 2025 -0300

    Store latest_block_slot in state summary

commit ecb647f
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 00:04:41 2025 -0300

    Fix column prefix bug

commit 36ab17c
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 23:35:44 2025 -0300

    Better traceability for hdiff errors

commit 33615ea
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 18:51:47 2025 -0300

    Document migration better

commit e6fb686
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 01:29:17 2025 -0300

    Send it boy

commit d58d8ef
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 14:52:27 2025 -0300

    Update tests

commit f8dbda4
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Wed Mar 5 23:51:41 2025 -0300

    Add more details to errors

commit 8931141
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 6 12:16:45 2025 +1100

    Abolish temporary states concept

commit abb3c3f
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 17:14:56 2025 +1100

    Prevent deletion of payloads >= split slot

commit 5cc266c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 13:27:40 2025 +1100

    Clean up DB migrations

commit 7abbaeb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 11:49:35 2025 +1100

    Use descent from finality instead of viability

commit 54010b0
Author: Lion - dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Wed Feb 19 02:49:19 2025 -0300

    Update consensus/proto_array/src/proto_array.rs

    Co-authored-by: Michael Sproul <michael@sigmaprime.io>

commit cf3b776
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 18 14:59:03 2025 +1100

    Correct assert in `revert_minority_fork_on_resume`

commit 37be9ae
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 16:51:42 2025 +1100

    Tweaks in `prune_hot_db`.

commit f6786eb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:46:41 2025 +1100

    Tidy and document `migrate_database`.

commit 1dc6d5e
Merge: 7033656 6ab6eae
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:16:34 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit 7033656
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:16:13 2025 +1100

    Fix compilation and remove error from `heads`

commit b9d8ae7
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Tue Feb 4 16:15:05 2025 -0300

    Fix nodes_without_children

commit ed97b97
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Tue Feb 4 15:51:48 2025 -0300

    Use slot clock in heads

commit 12fa5a8
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 4 10:58:06 2025 +1100

    Remove some persisted head stuff

commit 91eab38
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 20:50:39 2025 -0300

    Deprecate block DAG for pruning

commit e56299c
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 19:50:02 2025 -0300

    Annotate SummariesDagError error

commit 979e43a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 4 09:23:58 2025 +1100

    Tweak logs

commit 663dfd3
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 18:00:37 2025 -0300

    Update tests

commit 066f96a
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 17:46:36 2025 -0300

    Prevent very long log line

commit c5b4293
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 17:39:22 2025 -0300

    Prune descendants of finalized checkpoint not finalized block

commit 28d7b74
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 16:38:51 2025 -0300

    Add states descendants_of

commit 10bbb2e
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 16:17:52 2025 -0300

    Log about multiple roots in dag tree

commit 8c9a1b2
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Jan 20 18:41:51 2025 +0700

    Implement db schema upgrade and downgrade

commit 8c15bab
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Jan 10 15:14:35 2025 +0800

    Improve state summary dag compute logic

commit be105d1
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Sat Dec 28 21:33:09 2024 +0800

    Drop head tracker for summaries dag
michaelsproul added a commit that referenced this pull request Jun 16, 2025
@michaelsproul
Hierarchical state diffs in hot DB (#6750)
7935c00 
Squashed commit of the following:

commit 629fa73
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Sat Jun 14 12:58:45 2025 +1000

    Tweak hdiff size metric buckets

commit 9c8e58c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Jun 13 17:16:27 2025 +1000

    Metric for hdiff sizes

commit 707557a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Jun 11 15:36:18 2025 +1000

    Clean up hdiff timing metrics

commit 22f7f73
Merge: 9e77f82 8c6abc0
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Jun 11 14:36:04 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 9e77f82
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Jun 2 17:31:17 2025 +1000

    Remove FIXMEs/mess

commit 4913987
Merge: 80a5353 ae30480
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Jun 2 17:13:35 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 80a5353
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 17:28:49 2025 +1000

    Remove some stale FIXMEs/typos

commit bb23f2a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 16:30:35 2025 +1000

    Add a new test and fix split loading

commit 6094e23
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 15:50:45 2025 +1000

    Clean up test assert

commit 06c2632
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 15:33:46 2025 +1000

    Typo fix

commit 064115c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 13:49:25 2025 +1000

    Fix DB manager downgrade

commit 03fece6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 12:35:37 2025 +1000

    Skip migrating pre-split states in downgrade

commit f0823fe
Merge: bc47fd6 0ddf9a9
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 09:12:39 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit bc47fd6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 16:50:24 2025 +1000

    Avoid putting pre-split states in the state cache

commit 5fb55be
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 15:38:50 2025 +1000

    Fix migration of dense diffs

commit 9acb1cf
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 13:27:37 2025 +1000

    Fix one schema test and add a new one that's broken :sunglasses:

commit 78d0496
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 10:56:45 2025 +1000

    Rework store config and compatibility checks

commit 8ebe1b2
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 27 17:02:49 2025 +1000

    Add test for get_ancestor_state_root

commit b0191db
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 26 17:50:34 2025 +1000

    Fix split slot migration

commit 9800ab8
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 26 16:34:05 2025 +1000

    Attempt to fix archive node V24 upgrade

commit 2485beb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 22 17:03:06 2025 +1000

    Add logging for downgrade

commit d045796
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 22 11:10:46 2025 +1000

    Align hot grid to freezer when migrating archive nodes

commit 444c1cd
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 21 15:23:11 2025 +1000

    Add a test for states retained for hot diffs

commit 5d8ddb6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 21 12:22:00 2025 +1000

    Delete temporary states on migration

commit a4f442c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 17:47:53 2025 +1000

    Clean up some more TODOs

commit c39daf2
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 17:41:31 2025 +1000

    Correct V23 -> V24 in load_split comment

commit c12dd1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 16:05:57 2025 +1000

    Split hdiff metrics by hot/cold

commit 1096565
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:27:04 2025 +1000

    Move legacy state storage code into migration file

commit 6887ad7
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:14:00 2025 +1000

    Tweak comments in v24 migration

commit b73cb1e
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:03:24 2025 +1000

    Finish PruningCheckpoint thing

commit b681648
Merge: f83b083 23ad833
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 16:28:40 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit f83b083
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 16:27:03 2025 +1000

    WIP remove pruning checkpoint

commit 00ef82a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 12:43:10 2025 +1000

    Update comment/remove TODO

commit c74913f
Merge: 7d8343f 851ee2b
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 15 11:02:40 2025 +1000

    Merge branch 'unstable' into tree-states-hot-rebase

commit 7d8343f
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 8 14:59:10 2025 +1000

    Use same hierarchy for hot and cold

    This is nice as it enables us to avoid recomputing diffs, we can just copy.

commit e1475a1
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 8 14:43:34 2025 +1000

    Prevent split from changing during ancestor calc

commit 8fa3665
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 1 13:20:44 2025 +1000

    Remove non-contiguous DAG checks

commit 54ded28
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Apr 30 09:48:10 2025 +1000

    Use 0u8 inside DiffBaseState::Snapshot

commit 1184d72
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 29 19:20:53 2025 +1000

    More type-safe diff base state

commit 088cfa0
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 29 18:32:21 2025 +1000

    Simplify migration logic

commit fcbec47
Merge: 00fbd82 476f3a5
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 15 11:05:18 2025 +1000

    Merge branch 'unstable' into tree-states-hot-rebase

commit 00fbd82
Author: hopinheimer <48147533+hopinheimer@users.noreply.github.com>
Date:   Mon Apr 14 21:04:53 2025 -0400

    Delete `transaction_mutex` in store (#7311)

    * remove  from db

    * remove dependent code

    * clippy happy

    * fixing clippy issues

commit 990ba80
Merge: f70e543 d96b731
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 14:36:43 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit f70e543
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 13:14:58 2025 +1000

    Fix anchor archives

commit 8657b08
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 12:46:21 2025 +1000

    Add note about multiple DAG roots

commit 74ebf8b
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Apr 7 17:04:36 2025 +1000

    Fix clippy and tests

commit fcc96a1
Merge: 9151436 70850fe
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Apr 7 17:00:29 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 9151436
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 3 13:54:31 2025 +1100

    Fix test OOM issues on tree-states-hot (#7176)

    * Try rebasing

    * Heaptrack

    * Try to prevent and detect circular references

    * Don't use StateRootsIterator in get_ancestor_state_root

    * Skip one slot in get_ancestor_state_root

    * Heaptrack clippy fix

    * Fix store test

    * Log diff base state root

    * Jump by slots per historical vector

    * Maybe ok fix for test

    * get_ancestor_state_root

    * lint

    * Implement downgrade from v24

    * Better on state write

    * Log on ws test chain dump

    * Fix WSS tests

    * Tweak condition

    * Revert "Heaptrack"

    This reverts commit f69c38c.

    * Reduce diff

    * Use debug repr

    * Spelling

    ---------

    Co-authored-by: dapplion <35266934+dapplion@users.noreply.github.com>

commit b49272f
Merge: 1c81c93 a322463
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 18 15:58:59 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit a322463
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 18 15:53:20 2025 +1100

    Fix compilation

commit f4dd6fe
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Mar 17 14:56:15 2025 -0300

    Clean up temporary flags on migration

commit 1c81c93
Merge: 5b8680a 11cfa1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 17:00:39 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit 11cfa1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 15:47:58 2025 +1100

    Purge temporary states more, fixing bug

commit 5b8680a
Merge: 9f36dc8 b43c071
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 14:51:20 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit 9f36dc8
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 04:34:01 2025 -0300

    Don't include massive lists in errors

commit a1b45e6
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 04:33:25 2025 -0300

    Persist states even if in cache

commit b43c071
Merge: a613662 d60c24e
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 11:31:48 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit a928d30
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 16:49:37 2025 +1100

    Fix merge snafu

commit 3f23942
Merge: 4e74ed1 a613662
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 15:56:37 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit a613662
Merge: ebd05c7 1916a2a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 15:15:04 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit ebd05c7
Merge: d58d8ef b4e79ed
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Mar 10 18:08:37 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit 4e74ed1
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 02:12:12 2025 -0300

    Fix wrapping sub

commit ceb59e3
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 01:32:51 2025 -0300

    Don't log extra diffs as roots

commit f020adb
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 01:05:33 2025 -0300

    Store latest_block_slot in state summary

commit ecb647f
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 00:04:41 2025 -0300

    Fix column prefix bug

commit 36ab17c
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 23:35:44 2025 -0300

    Better traceability for hdiff errors

commit 33615ea
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 18:51:47 2025 -0300

    Document migration better

commit e6fb686
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 01:29:17 2025 -0300

    Send it boy

commit d58d8ef
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 14:52:27 2025 -0300

    Update tests

commit f8dbda4
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Wed Mar 5 23:51:41 2025 -0300

    Add more details to errors

commit 8931141
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 6 12:16:45 2025 +1100

    Abolish temporary states concept

commit abb3c3f
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 17:14:56 2025 +1100

    Prevent deletion of payloads >= split slot

commit 5cc266c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 13:27:40 2025 +1100

    Clean up DB migrations

commit 7abbaeb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 11:49:35 2025 +1100

    Use descent from finality instead of viability

commit 54010b0
Author: Lion - dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Wed Feb 19 02:49:19 2025 -0300

    Update consensus/proto_array/src/proto_array.rs

    Co-authored-by: Michael Sproul <michael@sigmaprime.io>

commit cf3b776
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 18 14:59:03 2025 +1100

    Correct assert in `revert_minority_fork_on_resume`

commit 37be9ae
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 16:51:42 2025 +1100

    Tweaks in `prune_hot_db`.

commit f6786eb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:46:41 2025 +1100

    Tidy and document `migrate_database`.

commit 1dc6d5e
Merge: 7033656 6ab6eae
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:16:34 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit 7033656
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:16:13 2025 +1100

    Fix compilation and remove error from `heads`

commit b9d8ae7
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Tue Feb 4 16:15:05 2025 -0300

    Fix nodes_without_children

commit ed97b97
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Tue Feb 4 15:51:48 2025 -0300

    Use slot clock in heads

commit 12fa5a8
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 4 10:58:06 2025 +1100

    Remove some persisted head stuff

commit 91eab38
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 20:50:39 2025 -0300

    Deprecate block DAG for pruning

commit e56299c
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 19:50:02 2025 -0300

    Annotate SummariesDagError error

commit 979e43a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 4 09:23:58 2025 +1100

    Tweak logs

commit 663dfd3
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 18:00:37 2025 -0300

    Update tests

commit 066f96a
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 17:46:36 2025 -0300

    Prevent very long log line

commit c5b4293
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 17:39:22 2025 -0300

    Prune descendants of finalized checkpoint not finalized block

commit 28d7b74
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 16:38:51 2025 -0300

    Add states descendants_of

commit 10bbb2e
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 16:17:52 2025 -0300

    Log about multiple roots in dag tree

commit 8c9a1b2
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Jan 20 18:41:51 2025 +0700

    Implement db schema upgrade and downgrade

commit 8c15bab
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Jan 10 15:14:35 2025 +0800

    Improve state summary dag compute logic

commit be105d1
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Sat Dec 28 21:33:09 2024 +0800

    Drop head tracker for summaries dag
eserilev pushed a commit to eserilev/lighthouse that referenced this pull request Jun 17, 2025
@michaelsproul @eserilev
Hierarchical state diffs in hot DB (sigp#6750)
ea7f892 
Squashed commit of the following:

commit 629fa73
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Sat Jun 14 12:58:45 2025 +1000

    Tweak hdiff size metric buckets

commit 9c8e58c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Jun 13 17:16:27 2025 +1000

    Metric for hdiff sizes

commit 707557a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Jun 11 15:36:18 2025 +1000

    Clean up hdiff timing metrics

commit 22f7f73
Merge: 9e77f82 8c6abc0
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Jun 11 14:36:04 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 9e77f82
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Jun 2 17:31:17 2025 +1000

    Remove FIXMEs/mess

commit 4913987
Merge: 80a5353 ae30480
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Jun 2 17:13:35 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 80a5353
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 17:28:49 2025 +1000

    Remove some stale FIXMEs/typos

commit bb23f2a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 16:30:35 2025 +1000

    Add a new test and fix split loading

commit 6094e23
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 15:50:45 2025 +1000

    Clean up test assert

commit 06c2632
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 15:33:46 2025 +1000

    Typo fix

commit 064115c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 13:49:25 2025 +1000

    Fix DB manager downgrade

commit 03fece6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 12:35:37 2025 +1000

    Skip migrating pre-split states in downgrade

commit f0823fe
Merge: bc47fd6 0ddf9a9
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 29 09:12:39 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit bc47fd6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 16:50:24 2025 +1000

    Avoid putting pre-split states in the state cache

commit 5fb55be
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 15:38:50 2025 +1000

    Fix migration of dense diffs

commit 9acb1cf
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 13:27:37 2025 +1000

    Fix one schema test and add a new one that's broken :sunglasses:

commit 78d0496
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 28 10:56:45 2025 +1000

    Rework store config and compatibility checks

commit 8ebe1b2
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 27 17:02:49 2025 +1000

    Add test for get_ancestor_state_root

commit b0191db
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 26 17:50:34 2025 +1000

    Fix split slot migration

commit 9800ab8
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 26 16:34:05 2025 +1000

    Attempt to fix archive node V24 upgrade

commit 2485beb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 22 17:03:06 2025 +1000

    Add logging for downgrade

commit d045796
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 22 11:10:46 2025 +1000

    Align hot grid to freezer when migrating archive nodes

commit 444c1cd
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 21 15:23:11 2025 +1000

    Add a test for states retained for hot diffs

commit 5d8ddb6
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed May 21 12:22:00 2025 +1000

    Delete temporary states on migration

commit a4f442c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 17:47:53 2025 +1000

    Clean up some more TODOs

commit c39daf2
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 17:41:31 2025 +1000

    Correct V23 -> V24 in load_split comment

commit c12dd1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue May 20 16:05:57 2025 +1000

    Split hdiff metrics by hot/cold

commit 1096565
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:27:04 2025 +1000

    Move legacy state storage code into migration file

commit 6887ad7
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:14:00 2025 +1000

    Tweak comments in v24 migration

commit b73cb1e
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 17:03:24 2025 +1000

    Finish PruningCheckpoint thing

commit b681648
Merge: f83b083 23ad833
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 16:28:40 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit f83b083
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 16:27:03 2025 +1000

    WIP remove pruning checkpoint

commit 00ef82a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon May 19 12:43:10 2025 +1000

    Update comment/remove TODO

commit c74913f
Merge: 7d8343f 851ee2b
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 15 11:02:40 2025 +1000

    Merge branch 'unstable' into tree-states-hot-rebase

commit 7d8343f
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 8 14:59:10 2025 +1000

    Use same hierarchy for hot and cold

    This is nice as it enables us to avoid recomputing diffs, we can just copy.

commit e1475a1
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 8 14:43:34 2025 +1000

    Prevent split from changing during ancestor calc

commit 8fa3665
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu May 1 13:20:44 2025 +1000

    Remove non-contiguous DAG checks

commit 54ded28
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Wed Apr 30 09:48:10 2025 +1000

    Use 0u8 inside DiffBaseState::Snapshot

commit 1184d72
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 29 19:20:53 2025 +1000

    More type-safe diff base state

commit 088cfa0
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 29 18:32:21 2025 +1000

    Simplify migration logic

commit fcbec47
Merge: 00fbd82 476f3a5
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Apr 15 11:05:18 2025 +1000

    Merge branch 'unstable' into tree-states-hot-rebase

commit 00fbd82
Author: hopinheimer <48147533+hopinheimer@users.noreply.github.com>
Date:   Mon Apr 14 21:04:53 2025 -0400

    Delete `transaction_mutex` in store (sigp#7311)

    * remove  from db

    * remove dependent code

    * clippy happy

    * fixing clippy issues

commit 990ba80
Merge: f70e543 d96b731
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 14:36:43 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit f70e543
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 13:14:58 2025 +1000

    Fix anchor archives

commit 8657b08
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 10 12:46:21 2025 +1000

    Add note about multiple DAG roots

commit 74ebf8b
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Apr 7 17:04:36 2025 +1000

    Fix clippy and tests

commit fcc96a1
Merge: 9151436 70850fe
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Apr 7 17:00:29 2025 +1000

    Merge remote-tracking branch 'origin/unstable' into tree-states-hot-rebase

commit 9151436
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Apr 3 13:54:31 2025 +1100

    Fix test OOM issues on tree-states-hot (sigp#7176)

    * Try rebasing

    * Heaptrack

    * Try to prevent and detect circular references

    * Don't use StateRootsIterator in get_ancestor_state_root

    * Skip one slot in get_ancestor_state_root

    * Heaptrack clippy fix

    * Fix store test

    * Log diff base state root

    * Jump by slots per historical vector

    * Maybe ok fix for test

    * get_ancestor_state_root

    * lint

    * Implement downgrade from v24

    * Better on state write

    * Log on ws test chain dump

    * Fix WSS tests

    * Tweak condition

    * Revert "Heaptrack"

    This reverts commit f69c38c.

    * Reduce diff

    * Use debug repr

    * Spelling

    ---------

    Co-authored-by: dapplion <35266934+dapplion@users.noreply.github.com>

commit b49272f
Merge: 1c81c93 a322463
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 18 15:58:59 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit a322463
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 18 15:53:20 2025 +1100

    Fix compilation

commit f4dd6fe
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Mar 17 14:56:15 2025 -0300

    Clean up temporary flags on migration

commit 1c81c93
Merge: 5b8680a 11cfa1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 17:00:39 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit 11cfa1c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 15:47:58 2025 +1100

    Purge temporary states more, fixing bug

commit 5b8680a
Merge: 9f36dc8 b43c071
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 14:51:20 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit 9f36dc8
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 04:34:01 2025 -0300

    Don't include massive lists in errors

commit a1b45e6
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 04:33:25 2025 -0300

    Persist states even if in cache

commit b43c071
Merge: a613662 d60c24e
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 13 11:31:48 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit a928d30
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 16:49:37 2025 +1100

    Fix merge snafu

commit 3f23942
Merge: 4e74ed1 a613662
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 15:56:37 2025 +1100

    Merge remote-tracking branch 'origin/drop-headtracker' into tree-states-hot-rebase

commit a613662
Merge: ebd05c7 1916a2a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Mar 11 15:15:04 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit ebd05c7
Merge: d58d8ef b4e79ed
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Mon Mar 10 18:08:37 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit 4e74ed1
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 02:12:12 2025 -0300

    Fix wrapping sub

commit ceb59e3
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 01:32:51 2025 -0300

    Don't log extra diffs as roots

commit f020adb
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 01:05:33 2025 -0300

    Store latest_block_slot in state summary

commit ecb647f
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Mar 7 00:04:41 2025 -0300

    Fix column prefix bug

commit 36ab17c
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 23:35:44 2025 -0300

    Better traceability for hdiff errors

commit 33615ea
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 18:51:47 2025 -0300

    Document migration better

commit e6fb686
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 01:29:17 2025 -0300

    Send it boy

commit d58d8ef
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Thu Mar 6 14:52:27 2025 -0300

    Update tests

commit f8dbda4
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Wed Mar 5 23:51:41 2025 -0300

    Add more details to errors

commit 8931141
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Mar 6 12:16:45 2025 +1100

    Abolish temporary states concept

commit abb3c3f
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 17:14:56 2025 +1100

    Prevent deletion of payloads >= split slot

commit 5cc266c
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 13:27:40 2025 +1100

    Clean up DB migrations

commit 7abbaeb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Thu Feb 20 11:49:35 2025 +1100

    Use descent from finality instead of viability

commit 54010b0
Author: Lion - dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Wed Feb 19 02:49:19 2025 -0300

    Update consensus/proto_array/src/proto_array.rs

    Co-authored-by: Michael Sproul <michael@sigmaprime.io>

commit cf3b776
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 18 14:59:03 2025 +1100

    Correct assert in `revert_minority_fork_on_resume`

commit 37be9ae
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 16:51:42 2025 +1100

    Tweaks in `prune_hot_db`.

commit f6786eb
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:46:41 2025 +1100

    Tidy and document `migrate_database`.

commit 1dc6d5e
Merge: 7033656 6ab6eae
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:16:34 2025 +1100

    Merge remote-tracking branch 'origin/unstable' into drop-headtracker

commit 7033656
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Fri Feb 14 15:16:13 2025 +1100

    Fix compilation and remove error from `heads`

commit b9d8ae7
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Tue Feb 4 16:15:05 2025 -0300

    Fix nodes_without_children

commit ed97b97
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Tue Feb 4 15:51:48 2025 -0300

    Use slot clock in heads

commit 12fa5a8
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 4 10:58:06 2025 +1100

    Remove some persisted head stuff

commit 91eab38
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 20:50:39 2025 -0300

    Deprecate block DAG for pruning

commit e56299c
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 19:50:02 2025 -0300

    Annotate SummariesDagError error

commit 979e43a
Author: Michael Sproul <michael@sigmaprime.io>
Date:   Tue Feb 4 09:23:58 2025 +1100

    Tweak logs

commit 663dfd3
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 18:00:37 2025 -0300

    Update tests

commit 066f96a
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 17:46:36 2025 -0300

    Prevent very long log line

commit c5b4293
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 17:39:22 2025 -0300

    Prune descendants of finalized checkpoint not finalized block

commit 28d7b74
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 16:38:51 2025 -0300

    Add states descendants_of

commit 10bbb2e
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Feb 3 16:17:52 2025 -0300

    Log about multiple roots in dag tree

commit 8c9a1b2
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Mon Jan 20 18:41:51 2025 +0700

    Implement db schema upgrade and downgrade

commit 8c15bab
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Fri Jan 10 15:14:35 2025 +0800

    Improve state summary dag compute logic

commit be105d1
Author: dapplion <35266934+dapplion@users.noreply.github.com>
Date:   Sat Dec 28 21:33:09 2024 +0800

    Drop head tracker for summaries dag
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@michaelsproul michaelsproul michaelsproul approved these changes

Assignees
No one assigned
Labels
tree-states Ongoing state and database overhaul
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@hopinheimer @michaelsproul