AllyCat is full stack, open source chatbot that uses GenAI LLMs to answer questions about your website. It is simple by design and will run on your laptop or server.

AllyCat is purposefully simple so it can be used by developers to learn how RAG-based GenAI works. Yet it is powerful enough to use with your website, You may also extend it for your own purposes.

⭐ Found this tool helpful? Give it a star on GitHub to support the project and help others discover it!

🗞️ Allycat news - releases and new features!

AllyCat uses your choice of LLM and vector database to implement a chatbot written in Python using RAG architecture. AllyCat also includes web scraping tools that extract data from your website (or any website).

1. Chatbot with interface to answer questions with text scraped from a website.
2. Includes web crawling & scraping, text extraction, data/HTML processing, conversion to markdown.
   • Currently uses: Data Prep Kit Connector and Docling
3. Processing Chunking, vector embedding creation, saving to vector database.
   • Currently uses: Llama Index and Granite Embedding Model
4. Supports multiple LLMs.
   • Currently: Llama or Granite
5. Supports multiple vector databases.
   • Currently: Milvus or Weaviate
6. End User and New Contributor Friendly.
   • Currently: Run locally with Ollama, or as-a-service on Replicate

There are two ways to run Allycat.

A great option for a quick evaluation.
See running AllyCat using docker

Choose this option if you want to tweak AllyCat to fit your needs. For example, experimenting with embedding models or LLMs.
See running AllyCat natively

See running allycat

See customizing allycat

See deployment guide

See developing allycat

Originally AllianceChat, we shortened it to AllyCat when we learned chat means cat in French. Who doesn't love cats?!