Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 17.4k 2.8k

2. Awesome-LLM-Training-Serving Awesome-LLM-Training-Serving Public

   A lightweight yet reusable template for LLM training, covering both tutorial-style examples (DP, DDP, MP, PP, Accelerate, DeepSpeed, FSDP) and real-world applications (LLAMA-FACTORY, OpenRLHF).

   Python 1

3. oceanbase/miniob oceanbase/miniob Public

   MiniOB is a compact database that assists developers in understanding the fundamental workings of a database.

   C++ 3.9k 1.4k

4. hiyouga/LLaMA-Factory hiyouga/LLaMA-Factory Public

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

   Python 56.9k 7k

5. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python 149k 30.2k

6. ai_infra_bench ai_infra_bench Public

   End-to-end automated benchmarking for AI infrastructure workflows.

   Python 1