Popular repositories Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

2. Awesome-ML-SYS-Tutorial Awesome-ML-SYS-Tutorial Public

   Forked from zhaochenyang20/Awesome-ML-SYS-Tutorial

   My learning notes/codes for ML SYS.

   Python

3. lm-evaluation-harness lm-evaluation-harness Public

   Forked from Monstertail/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python

4. simple-evals simple-evals Public

   Forked from openai/simple-evals

   Python

5. MHA2MLA MHA2MLA Public

   Forked from JT-Ushio/MHA2MLA

   Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs

   Python