#

llama-cpp

Here are 7 public repositories matching this topic...

fboulnois / llama-cpp-docker

Run llama.cpp in a GPU accelerated Docker container

docker docker-compose llama mistral llm chatgpt llama-cpp llama2 llama3

Updated Jul 17, 2025
Shell

runpod-llm

zeeb0tt / runpod-llm

Runpod-LLM provides ready-to-use container scripts for running large language models (LLMs) easily on RunPod.

llm runpod llms llmops llm-serving llamacpp llama-cpp llm-training llm-inference runpod-worker ollama llama-cpp-python ollama-api runpod-serverless runpods llamacpp-python runpod-endpoint

Updated May 20, 2025
Shell

BjornMelin / local-llm-workbench

🧠 A comprehensive toolkit for benchmarking, optimizing, and deploying local Large Language Models. Includes performance testing tools, optimized configurations for CPU/GPU/hybrid setups, and detailed guides to maximize LLM performance on your hardware.

cuda gpu-acceleration model-management inference-optimization model-quantization cpu-inference llama-cpp local-llm llm-deployment llm-benchmarking ollama-optimization hybrid-inference wsl-ai-setup context-window-scaling

Updated Mar 27, 2025
Shell

VIS-WA / LLM-replication

Repo to download, save and run quantised LLM models using Llama.cpp and benchmark the results (private use)

bash benchmark llama-cpp llm-inference

Updated Feb 28, 2024
Shell

nimadez / cli

Debian Assistant CLI (private)

android linux security networking debian command-line proxy linux-kernel installation scripts-collection bookworm trixie gnome-extensions llama-cpp

Updated Aug 7, 2025
Shell

ukkit / llama-chat

Lightweight web UI for llama.cpp with dynamic model switching, chat history & markdown support. No GPU required. Perfect for local AI development.

javascript sqlite self-hosted developer-tools web-interface python-flask chat-ui ai-assistant conversation-history model-switching cpu-inference performance-optimized llama-cpp local-ai llm-frontend open-source-ai offline-ai private-ai markdown-chat

Updated Jun 23, 2025
Shell

erno-szabados / geany-llama-plugin

A simple plugin for geany to interact with openai compatible LLMs (llama.cpp's llama-server)

plugin rpm geany opensuse-leap openai-api llama-cpp

Updated May 17, 2025
Shell

Improve this page

Add a description, image, and links to the llama-cpp topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llama-cpp topic, visit your repo's landing page and select "manage topics."