Pinned Loading

1. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

   C++ 11.5k 1.7k

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python