Merged
Conversation
- Add Venice AI as 4th provider (OpenAI-compatible API) - Support for Llama 3.3 70B, DeepSeek R1, Qwen 2.5, Dolphin models - Auto-detect VENICE_API_KEY and include in available providers - Add VENICE_MODELS array and MODELS.VENICE_* exports - Update model routing to handle venice/ prefix - Update README with Venice documentation and VVV token link - Works with just Venice API key in single-model mode Venice AI: https://venice.ai VVV Token: https://venice.ai/token
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds Venice AI as a 4th provider to the multi-model toolkit.
Venice AI
Venice AI provides uncensored AI models with private inference, powered by the VVV token.
Changes
getVenice()client (OpenAI-compatible API)VENICE_API_KEYenv variable supportMODELSexport:VENICE_LLAMA_70B- Llama 3.3 70BVENICE_LLAMA_3B- Llama 3.2 3BVENICE_DEEPSEEK_R1- DeepSeek R1 671BVENICE_DEEPSEEK_LLAMA- DeepSeek R1 Llama 70BVENICE_DOLPHIN- Dolphin (uncensored)VENICE_QWEN- Qwen 2.5 72BgetAvailableProviders()venice/model prefix incomplete()Usage
# .env VENICE_API_KEY=your_key_here