-
-
Notifications
You must be signed in to change notification settings - Fork 70
Open
Description
The vector indices that support the vss0
virtual table are limited to 1GB. This is because they are stored as a BLOB in a single row in a shadow table, which has a limit of ~1GB.
Instead, we should store large FAISS indices across several rows, so they can (in theory) grow with infinite space. This will likely be complicated and require the SQLite BLOB I/O API and a custom faiss IOWriter.
turbo, ajbouh, trodrigu, budhash, teowave and 16 more
Metadata
Metadata
Assignees
Labels
No labels