Skip to content

alikhalajii/multi_llm_chatbot

Repository files navigation

Multi-LLM Chatbot

⚠️ Work in Progress: This project is in early development.
Features, structure, and documentation will evolve quickly.

A multilingual retrieval-augmented chatbot powered by LangChain, Together AI, FastAPI, and pgvector, with the ability to easily switch between different language models.


Usage

Option 1: Local Development

# 1. Create and activate a new virtual environment
python -m venv .venv
source .venv/bin/activate

# 2. Install repo as a package
pip install -e .[dev]

# 3. Add your TogetherAI API key in the `.env` file

# 4. Start backend + frontend + db (hot reload)
make dev

Option 2: Docker Compose

docker compose up --build

Backend API → http://localhost:8000/docs

Gradio UI → http://localhost:7860

Upload Document

Documents

Select Model and Chat

Chat

About

Multilingual retrieval-augmented chatbot, FastAPI, Gradio, PGVector

Topics

Resources

Stars

Watchers

Forks