๐๏ธ Getting Started - E2E Tutorial
End-to-End tutorial for LiteLLM Proxy to:
๐๏ธ Config.yaml
3 items
๐๏ธ Setup & Deployment
8 items
๐๏ธ Demo App
Here is a demo of the proxy. To log in pass in:
๐๏ธ Architecture
8 items
๐ All Endpoints (Swagger)
๐๏ธ โจ Enterprise Features
To get a license, get in touch with us here
๐๏ธ LiteLLM Proxy CLI
The litellm-proxy CLI is a command-line tool for managing your LiteLLM proxy
๐๏ธ Making LLM Requests
5 items
๐๏ธ Authentication
8 items
๐๏ธ Model Access
2 items
๐๏ธ Admin UI
9 items
๐๏ธ Spend Tracking
3 items
๐๏ธ Budgets + Rate Limits
5 items
๐ Load Balancing, Routing, Fallbacks
๐๏ธ Logging, Alerting, Metrics
4 items
๐๏ธ Secret Managers
2 items
๐๏ธ Create Custom Plugins
Modify requests, responses, and more
๐๏ธ Caching
For OpenAI/Anthropic Prompt Caching, go here