litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Python v1.81.14-stable.gpt-5.4-patch6 πŸ”’ 14 vulns Β· CRITICAL πŸ“¦ 87.1M/mo
38.3k stars  Β·  6.3k forks  Β·  Updated  Β·  NOASSERTION
Install
pip install litellm
View on GitHub
πŸ“„ Documentation
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenai
Supported APIs (660)

The Account API gives sellers the ability to configure their eBay seller accounts, including the seller's policies (eBay

The Analytics API provides data and information about a seller and their eBay business. The resources and methods in thi

Service for providing information to sellers about their listings being non-compliant, or at risk for becoming non-compl

Interface specification for the DVLA Vehicle Enquiry API

api.video media unknown

api.video is an API that encodes on the go to facilitate immediate playback, enhancing viewer streaming experiences acro

Wikipedia for Web APIs. Repository of API definitions in OpenAPI format. Warning: If you want to be notified about chang

Azure Enterprise Knowledge Graph Service is a platform for creating knowledge graphs at scale.

The service for managing third party addons.

Version history All releases β†—

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.81.14-stable.gpt-5.4-patch5...v1.81.14-stable.gpt-5.4-patch6

## What's Changed * fix(gemini): preserve $ref in JSON Schema for Gemini 2.0+ by @Chesars in https://github.com/BerriAI/litellm/pull/21597 * fix(trans…

## What's Changed * fix(gemini): preserve $ref in JSON Schema for Gemini 2.0+ by @Chesars in https://github.com/BerriAI/litellm/pull/21597 * fix(trans…

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.81.14-stable.gpt-5.4_patch...v1.81.14-stable.gpt-5.4_patch2

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.81.14-stable.gpt-5.4_patch2...v1.81.14-stable.gpt-5.4-patch5

## What's Changed * fix(gemini): preserve $ref in JSON Schema for Gemini 2.0+ by @Chesars in https://github.com/BerriAI/litellm/pull/21597 * fix(trans…

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.82.0.patch1...v1.82.0.patch2

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.82.0-nightly...v1.82.0.patch1

πŸ”’ Security advisories (14)
HIGH
Arbitrary file deletion in litellm
CVE: CVE-2024-4888Fixed in 1.35.36Details β†—
CRITICAL
LiteLLM has Server-Side Template Injection vulnerability in /completions endpoint
CVE: CVE-2024-2952Fixed in 1.34.42Details β†—
HIGH
LiteLLM Vulnerable to Remote Code Execution (RCE)
CVE: CVE-2024-6825No fix availableDetails β†—
HIGH
litellm passes untrusted data to `eval` function without sanitization
CVE: CVE-2024-4264No fix availableDetails β†—
HIGH
LiteLLM Has a Leakage of Langfuse API Keys
CVE: CVE-2025-0330No fix availableDetails β†—
MEDIUM
SQL injection in litellm
CVE: CVE-2024-4890No fix availableDetails β†—
HIGH
LiteLLM Vulnerable to Denial of Service (DoS) via Crafted HTTP Request
CVE: CVE-2024-8984Fixed in 1.56.2Details β†—
HIGH
LiteLLM Has an Improper Authorization Vulnerability
CVE: CVE-2025-0628Fixed in 1.61.15Details β†—
HIGH
LiteLLM Server-Side Request Forgery (SSRF) vulnerability
CVE: CVE-2024-6587Fixed in 1.44.8Details β†—
HIGH
LiteLLM Reveals Portion of API Key via a Logging File
CVE: CVE-2024-9606Fixed in 1.44.12Details β†—
CRITICAL
litellm vulnerable to remote code execution based on using eval unsafely
CVE: CVE-2024-5751Fixed in 1.40.16Details β†—
HIGH
LiteLLM Vulnerable to Denial of Service (DoS)
CVE: CVE-2024-10188Fixed in 1.53.1.dev1Details β†—
MEDIUM
SQL injection in litellm
CVE: CVE-2024-5225Fixed in 1.40.0Details β†—
MEDIUM
litellm vulnerable to improper access control in team management
CVE: CVE-2024-5710Fixed in 1.40.15Details β†—
Data from OSV.dev
Quality signals
Score
Stars38.3k
Forks6.3k
Last updated
LicenseNOASSERTION
Supported APIs (660)
api.ebay.comapi.ebay.comapi.ebay.comapi.gov.ukapi.videoapis.guruazure.comazure.com
+ 652 more β€” see Supported APIs below
πŸ“¦ Package statsPyPI β†—
Monthly downloads87.1M