-
Notifications
You must be signed in to change notification settings - Fork 13k
Closed
Labels
enhancementNew feature or requestNew feature or requestmodelModel specificModel specificperformanceSpeed related topicsSpeed related topicsstaletestingEverything test relatedEverything test related
Description
Motivation
In the context of:
Need to add some models in the GGML HF Repo:
- mixtral8x7B Q4 Q8 F16 in split format
- bert-bge-large F16
- llama7B 13B split Q4 F16
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestmodelModel specificModel specificperformanceSpeed related topicsSpeed related topicsstaletestingEverything test relatedEverything test related