[Feature]: Add LiteLLM provider

[donovanrost]

Feature Type

New provider

Provider (if applicable)

litellm

Description

Many companies are hosting models on bedrock or azure and proxy them via something like litellm, which is an AI Gateway.

Example Usage

No response

Can you contribute this?

Yes, I can submit a PR

[jalberto]

Tools like litellm and bifrost are starting to be essential to work with models easily and be able to trace and control the budget

[mikehostetler]

We've had some work on local LLM support - but frankly need some help in this area - I'll highlight this ask a bit more

[mikehostetler]

Closing this per current repo direction. The LiteLLM provider is not planned to land at this time.