llm-d
llm-d
llm-d is a Kubernetes-native high-performance distributed LLM inference framework
United States of America
llm-d incubation
llm-d-incubation
Incubating components of llm-d, a Kubernetes-native high-performance distributed LLM inference framework
Red Hat
RedHatOfficial
The GitHub organization for Red Hat. This organization contains unsupported open source projects and code that have been started by Red Hat associates.
Neural Magic
neuralmagic
Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM
Boston
Lance Ball
lance
I write software, cook food, exercise, take pictures, grow things.
Red Hat
He/him/his
Red Hat Asheville, NC