This function used for loading:
|
def load_config(config_path: Optional[str] = None) -> RAIConfig: |
requires that all vendors have defined options, which is fine when using a default configuration, but a bit bothersome when creating a custom deployment.
To illustrate:
[vendor]
simple_model = "ollama"
complex_model = "ollama"
embeddings_model = "ollama"
[ollama]
simple_model = "qwen3.5:9b"
complex_model = "qwen3.5:9b"
embeddings_model = "qwen3.5:9b"
base_url = "http://localhost:11434"
This config fails to load, even though I am certain that I will not be using any other vendor. I think it would be beneficial to support such minimal configs for users.
This function used for loading:
rai/src/rai_core/rai/initialization/model_initialization.py
Line 99 in 59d0e89
To illustrate:
This config fails to load, even though I am certain that I will not be using any other vendor. I think it would be beneficial to support such minimal configs for users.