#

llm-inference

Here are 35 public repositories matching this topic...

liguodongiot / llm-action

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

llm llmops llm-serving llm-training llm-inference

Updated Aug 3, 2025
HTML

felladrin / awesome-ai-web-search

List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search

information-retrieval awesome ai artificial-intelligence question-answering awesome-list metasearch web-search artificial-intelligence-projects rag generative-ai ai-search-engine llm-inference retrieval-augmented-generation generative-ai-tools generative-ai-projects

Updated Sep 5, 2025
HTML

jax-ml / scaling-book

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

roofline jax tpus llms llm-inference

Updated Sep 6, 2025
HTML

MLSys-Learner-Resources / Awesome-MLSys-Blogger

The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)

machine-learning machine-learning-systems mlsys llm llm-training llm-inference

Updated Jan 5, 2025
HTML

Muhtasham / llm-inference-simulator

🚀 LLM inference optimization simulator, modeling compute-bound prefill and memory-bound decode phases.

llm-inference

Updated Jul 12, 2025
HTML

JerryYin777 / Awesome-MLSys-Blogger

The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)

machine-learning-systems mlsys llm llm-training llm-inference

Updated Jan 5, 2025
HTML

AmanPriyanshu / API-LLM-Hub

A static-page vanilla-js interface for various LLM APIs (OpenAI, Claude, Gemini, Together).

javascript package vanilla-javascript vanilla-js gemini openai gpt claude gemini-api gpt-3 openai-api gpt-4 llm llms anthropic claude-ai anthropic-claude llm-inference togetherai

Updated Sep 19, 2024
HTML

iBz-04 / reeltek

A small VLM that sees everything

python ocr gpu-acceleration scene-understanding real-time-detection local-models tts-js huggingface vision-models vision-language-model llamacpp llm-inference vlms smolvlm

Updated Jun 2, 2025
HTML

meet447 / Chipling-AI

AI access made free for everyone!

flask api-rest stable-diffusion llm-inference videodiffusion

Updated Aug 20, 2025
HTML

harleyszhang / harleyszhang.github.io

🧗‍♂️ harleyszhang 的个人博客

blog awq llm llm-inference

Updated Sep 1, 2025
HTML

AI-battle-llama3-vs-qwen2

AiGptCode / AI-battle-llama3-vs-qwen2

Welcome to our AI Battle! Ask a question and let our two AI models battle it out

android windows api ai llm llm-inference qwen qwen2 llama3 llama3-meta-ai

Updated Jun 9, 2024
HTML

omerfarukoz / elanore

Web Client For Ollama - Llama LLM

python3 large-language-models llm-inference ollama ollama-webui ollama-interface ollama-client ollama-api llm-interface llama3 llama3-1

Updated Oct 4, 2024
HTML

alex0dd / llm-app-microservices-template

Template for building microservice-based apps with a frontend, backend, LLM serving engine (e.g., vllm), and nginx.

Updated Oct 4, 2024
HTML

austinweis / alpaca.cpp-gui

GUI for GGML Alpaca models

flask gui flask-application llama gpt alpaca llm llamacpp llm-inference gguf

Updated Sep 24, 2023
HTML

Surya-sourav / PromptCast.Ai

U'r 1 Click Podcast :)

text-to-speech ai deep-learning podcast python3 speech-synthesis flask-application generative-ai llm-inference

Updated Nov 2, 2024
HTML

lqhl / scaling-book

《How to Scale Your Model 中文版》，这是一本关于在TPU上扩展大型语言模型的简短博客式教科书。

book gpu tpu roofline jax llm llm-inference

Updated Aug 30, 2025
HTML

wellkilo / wellkilo.github.io

Personal website, dedicated to sharing some useful computer learning knowledge!

python nlp pytorch llm-inference

Updated Jun 21, 2025
HTML

mkschulz9 / multicultural-llm-negotiation

LLM-based international M&A negotiation simulator.

openai-api llm-inference llama-70b deepseek business-acquisition

Updated Apr 23, 2025
HTML

YagoLopez / nextjs-chatbot

Chat with webpages using IA and RAG

streaming chatbot ia rag llm llm-inference vercel-ai-sdk agentic-ai

Updated Mar 26, 2025
HTML

Node0 / llm-tools

My expanding collection of scripts and tools designed to aid in working with large language models, understanding their performance characteristics and context limitations.

statistics tokens tokenization llm llm-inference

Updated Jun 6, 2025
HTML

Improve this page

Add a description, image, and links to the llm-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-inference topic, visit your repo's landing page and select "manage topics."