Litellm

About Litellm

Litellm is a ai llm tool that python sdk, proxy server (ai gateway) to call 100+ llm apis in openai (or native) format, with cost tracking, guardrails, loadbalancing and logging. [bedrock, azure, openai, vertexai, cohere,. Available as free plan, it is listed in the MarkBook AI tools directory alongside ai llm from top providers.

Looking for Litellm alternatives or similar ai llm? MarkBook helps you compare features, pricing, and reviews across thousands of AI tools. Find the best ai llm for your specific needs.