A sophisticated portable AI solution with two distinct usage modes: Solo Ollama for lightweight portability and OpenWebUI Project for full web interface experience.
- Quick Overview
- Solo Ollama Usage
- OpenWebUI Project Setup
- Data Preservation Guide
- Installation Methods
- Troubleshooting
| Mode | Portability | Use Case | Requirements |
|---|---|---|---|
| Solo Ollama | โ Move anywhere | Lightweight AI, CLI interaction | Just 2 files |
| OpenWebUI Project | Full web interface, team projects | Full conda setup |
Perfect for: Quick deployment, testing, moving between systems
GetOllama.bat # used to download ollama.exe
OllamaCMD.bat # CLI wrapper to interact with ollama.exe
๐ ollama/
โโโ models/ # Directory for model files
โโโ lib/ # for any dependencies or libraries
โโโ ollama.exe # Main executable
- Install: Run
GetOllama.bat(downloads Ollama automatically) - Use: Run
OllamaCMD.bat(interactive AI chat) - Move: Copy entire
ollama/folder anywhere you want!
- โ True Portability: Works from USB, cloud drives, any location
- โ No Dependencies: No Python, no conda, no system installation
- โ Interactive CLI: Chat with AI models directly
- โ Auto Server Management: Starts/stops automatically
- โ
Local Model Storage: Models saved in
ollama/models/
ollama run llama2 # Chat with Llama2
ollama list # Show installed models
ollama pull mistral # Download new models
ollama ps # Show running models
exit # Quit and cleanupPerfect for: Professional use, web interface, data persistence, team collaboration
Important: OpenWebUI has static paths initially - requires proper setup for portability
- Clone/download the OpenWebUI project
- Place ALL scripts directly in the OpenWebUI root folder (not in subfolders)
๐ OpenWebUI-Project/ # Main OpenWebUI project folder
โโโ ๐ ollama/ # Ollama files
โโโ ๐ installer_files/ # Miniconda + environments
โโโ GetConda.bat # Miniconda installer
โโโ SetEnv.bat # Path configurator
โโโ online_openwebui_manager.bat # Online installation
โโโ offline_openwebui_manager.bat # Offline installation (wheel-based)
โโโ launch_openwebui.bat # Combined launcher
โโโ requirement.txt # All Python dependencies
โโโ [OpenWebUI project files...]
# 1. Install portable Miniconda
GetConda.bat
# 2. Configure environment paths
SetEnv.bat
# 3. Install Ollama
GetOllama.bat# Creates conda environment named 'open-webui' with Python 3.11
# This is REQUIRED - the environment must be named exactly 'open-webui'You have 2 options for OpenWebUI installation:
online_openwebui_manager.batFeatures:
- โ Always gets latest versions
- โ Automatic dependency resolution
- โ Requires internet during installation
- โ Slower (downloads everything)
Options:
- Create new environment + install OpenWebUI
- Update existing installation
- Delete and reinstall (fresh start)
offline_openwebui_manager.batFeatures:
- โ Pre-downloaded wheels: All dependencies stored locally
- โ Fast installation: No waiting for downloads
- โ Works offline: Install anywhere without internet
- โ Moving friendly: Perfect for portable setups
How it works:
- Downloads ALL
.whlfiles fromrequirement.txtto local folder - Installs everything from local wheels (super fast!)
- After moving project: Just run again, installs from local wheels
OpenWebUI stores all your data (users, chats, settings) in webui.db. Here's how to preserve it:
\installer_files\Environments\open-webui\Lib\site-packages\open_webui\data\webui.db
# BEFORE MOVING:
# 1. Backup your database
copy "webui.db" to safe location
# 2. Move entire OpenWebUI project folder
# 3. Run setup again (online/offline manager)
# 4. AFTER SETUP:
# Replace new webui.db with your old webui.db
# Your data is restored!- ๐ฅ User accounts (emails, usernames, passwords)
- ๐ฌ Chat history (all conversations)
- โ๏ธ Settings (configurations, preferences)
- ๐จ Customizations (themes, layouts)
Critical: Always backup
webui.dbbefore moving or reinstalling!
# Perfect for:
- Testing AI models quickly
- USB stick deployment
- Temporary installations
- No-setup-required usage
# Just run:
GetOllama.bat # Once
OllamaCMD.bat # Every time# Perfect for:
- Web-based AI interface
- Team collaboration
- Data persistence
- Custom workflows
# Setup once:
GetConda.bat โ SetEnv.bat โ offline_manager.bat
# Use daily:
launch_openwebui.bat
# Opens: http://localhost:8080- Initial setup: Use offline manager to download all wheels
- Before moving: Backup
webui.db - After moving: Run
SetEnv.bat+ offline manager - Restore data: Replace new
webui.dbwith backed up one
- SSD: Install on SSD for faster model loading
- RAM: 16GB+ for larger models
- GPU: Enable GPU acceleration in Ollama settings
# Ollama won't start
- Check if ollama.exe exists in ollama/ folder
- Run GetOllama.bat again
- Check antivirus blocking
# Models not loading
- Check ollama/models/ folder exists
- Try: ollama pull llama2# Environment not found
- Ensure conda environment named 'open-webui' exists
- Run SetEnv.bat after moving
# Installation fails
- Use offline manager for reliability
- Check requirement.txt is present
- Try reinstall option (option 3)
# Data lost after moving
- Check webui.db backup/restore process
- Verify database file permissions# OpenWebUI uses port 8080
- Check: netstat -an | find "8080"
- Close conflicting applications
- Or modify launch script for different port- Developers: Portable AI for coding assistance
- Researchers: Consistent environment across machines
- Teams: Shared AI interface with data persistence
- Enterprise: Offline deployment with security
- Students: Learn AI without complex installations