Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 56.7k 9.8k

2. dlrover dlrover Public template

   Forked from intelligent-machine-learning/dlrover

   DLRover: An Automatic Distributed Deep Learning System

   Python

3. LMCache LMCache Public

   Forked from LMCache/LMCache

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python

4. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

5. verl verl Public

   Forked from volcengine/verl

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python 1

6. FlagOpen/FlagCX FlagOpen/FlagCX Public

   C++ 85 31