Skip to content

Fr: expose binaryQuantized of meilisearch (faster search and lighter db) #1315

@thiswillbeyourgithub

Description

@thiswillbeyourgithub

Describe the feature you'd like

Hi,

binaryQuantized allows to keep only 1 and 0s in the embedding process, making the db way smaller and the search way faster. Depending on the model and dimensions the loss can actually be negligible.

In this example using binary embeddings uses 3% of the space (x32 compression) and retains 96% of the performance with a x25 speedup.

I'm not saying it should default to true but exposing the setting would be a good start!

Here's the doc

Describe the benefits this would bring to existing Karakeep users

Way faster search, way lower db size, usable on cheaper hardware.

Can the goal of this request already be achieved via other means?

No

Have you searched for an existing open/closed issue?

  • I have searched for existing issues and none cover my fundamental request

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions