Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 17.7k 2.8k

2. verl verl Public

   Forked from volcengine/verl

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. TensorRT-Model-Optimizer TensorRT-Model-Optimizer Public

   Forked from NVIDIA/TensorRT-Model-Optimizer

   A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment…

   Python

5. everyone-can-use-english everyone-can-use-english Public

   Forked from ZuodaoTech/everyone-can-use-english

   人人都能用英语