LiteLLM based AI Gateway

This operator provides AI gateway capabilities for routing and managing requests to Large Language Models (LLMs) across multiple providers. Implementations are provided by other operators, such as ai-gateway-litellm-operator.

The AI Gateway is a component that sits between an AI Agent and a Large Language Model (LLM). It can handle tasks such as routing requests to different models, managing authentication, logging, and other middleware functions.

How-To Guides

Step-by-step guides to get you up and running:

Reference

Detailed reference information for all components: