Popular repositories Loading

1. production-stack production-stack Public

   Forked from vllm-project/production-stack

   vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

4. KAI-Scheduler KAI-Scheduler Public

   Forked from NVIDIA/KAI-Scheduler

   KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale

   Go

5. openai-java openai-java Public

   Forked from openai/openai-java

   The official Java library for the OpenAI API

   Kotlin

6. genai-bench genai-bench Public

   Forked from sgl-project/genai-bench

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python