Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 17.4k 2.8k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 56.6k 9.8k

3. Infrasys-AI/AISystem Infrasys-AI/AISystem Public

   AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

   Jupyter Notebook 14.9k 2.2k

4. QuantLLM QuantLLM Public

   Quantization Kernel Library for LLM Inference

   C++