📄️ Mock Completion() Responses - Save Testing Costs 💰
For testing purposes, you can use completion() with mock_response to mock calling the completion endpoint.
📄️ Reliability - Retries, Fallbacks
LiteLLM helps prevent failed requests in 2 ways:
Retries, fallbacks, mock responses, and budget controls
For testing purposes, you can use completion() with mock_response to mock calling the completion endpoint.
LiteLLM helps prevent failed requests in 2 ways: