Create a Tool Gateway

This guide walks you through deploying an instance of the ToolGateway custom resource.

Before following this guide, make sure you have some kind of Tool Gateway Operator installed.

Create a ToolGateway Resource

  1. Create a ToolGateway resource file:

    apiVersion: runtime.agentic-layer.ai/v1alpha1
kind: ToolGateway
metadata:
  name: tool-gateway
  namespace: tool-gateway
spec:
  toolGatewayClassName: my-gateway-class

    Note: The toolGatewayClassName is optional and only needed if multiple gateway classes are defined in the cluster.

  2. Apply the configuration:

    kubectl apply -f my-toolgateway.yaml

Verify the Deployment

  1. Check the ToolGateway status:

    kubectl get toolgateways tool-gateway -n tool-gateway

  2. Verify the created resources:

    # Check the deployment created by the operator
kubectl get deployments -l app=tool-gateway -A

# Check the service
kubectl get services -l app=tool-gateway -A

  3. Check the pod logs:

    kubectl logs -l app=tool-gateway -n tool-gateway

Connect Tool Servers to the Gateway

Automatic (Default) Resolution

If your ToolGateway is deployed in the tool-gateway namespace, tool servers will automatically discover and attach to it without any additional configuration:

apiVersion: runtime.agentic-layer.ai/v1alpha1
kind: ToolServer
metadata:
  name: my-toolserver
spec:
  protocol: mcp
  transportType: http
  image: ghcr.io/agentic-layer/echo-mcp-server:0.3.0
  port: 8000
  # No toolGatewayRef needed - automatically resolves to the default gateway

Explicit Reference

To connect a tool server to a specific ToolGateway, use the toolGatewayRef field:

apiVersion: runtime.agentic-layer.ai/v1alpha1
kind: ToolServer
metadata:
  name: my-toolserver
spec:
  protocol: mcp
  transportType: http
  image: ghcr.io/agentic-layer/echo-mcp-server:0.3.0
  port: 8000
  toolGatewayRef:
    name: tool-gateway
    namespace: tool-gateway  # Optional: defaults to the ToolServer's namespace

Verify the Connection

Once a tool server is attached to a gateway, you can verify the connection:

# Check the tool server status - look for the gatewayUrl and toolGatewayRef fields
kubectl get toolserver my-toolserver -o yaml

# The "Tool Gateway" column shows the attached gateway name
kubectl get toolservers

Configure Environment Variables

You can pass environment variables and load them from ConfigMaps or Secrets:

apiVersion: runtime.agentic-layer.ai/v1alpha1
kind: ToolGateway
metadata:
  name: tool-gateway
  namespace: tool-gateway
spec:
  env:
    - name: LOG_LEVEL
      value: "INFO"
  envFrom:
    - secretRef:
        name: gateway-credentials
    - configMapRef:
        name: gateway-config

Related