Skip to content

cache: Keep cached suggestion when user types same letters #16

@VJHack

Description

@VJHack

Optimize the current cache mechanism such that when the user types the same letters as the current cached suggestion, we keep the suggestion displayed instead of sending a new request to the server. This will increase cache hits and reduce server load.

          Maybe we can use this cache mechanism to create a second set of hashes just for the current completion, so that when the user is typing the same letters as the suggestion, we do not send requests to the server and simply reuse the results from the cache.

Originally posted by @ggerganov in #15 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions