-
Notifications
You must be signed in to change notification settings - Fork 902
Open
Labels
backwards-incompatBackwards-incompatible API changeBackwards-incompatible API changedatabasemajor-taskA significant amount of work or conceptual task.A significant amount of work or conceptual task.optimizationSomething to make Lighthouse run more efficiently.Something to make Lighthouse run more efficiently.tree-statesOngoing state and database overhaulOngoing state and database overhaul
Description
Description
Beacon blocks alone now consume around 80GB of disk space on mainnet.
I think we could be more efficient with storage by using compression. Recently I'm particularly fond of zstd
compression, which is fast and could probably offer a 2-4x reduction.
The complicating factor is that compressing blocks requires a database schema upgrade, as well as a moderately sophisticated migration to copy and compress all the existing blocks.
Metadata
Metadata
Assignees
Labels
backwards-incompatBackwards-incompatible API changeBackwards-incompatible API changedatabasemajor-taskA significant amount of work or conceptual task.A significant amount of work or conceptual task.optimizationSomething to make Lighthouse run more efficiently.Something to make Lighthouse run more efficiently.tree-statesOngoing state and database overhaulOngoing state and database overhaul