The path to production
Run locally
Start your agent as an HTTP server with session management. This is the foundation for everything that follows.The server handles session creation, health checks, authentication, and metrics out of the box.
Built-in HTTP Server
API endpoints, session limits, and authentication
Containerize
Package your agent into a Docker image for deployment to any environment.
Docker Deployment
Dockerfiles for CPU and GPU, environment configuration
Scale out
Running multiple replicas? Add a Redis-backed session registry so any node can manage any session.
Horizontal Scaling
Redis session store, custom backends, heartbeat mechanism
Orchestrate
The complete setup: Helm chart, health probes, Redis, Prometheus scraping, and a Grafana dashboard.
Kubernetes Deployment
Step-by-step guide with monitoring included
Observe
Track latency, token usage, and errors across all components with OpenTelemetry. Works at any stage, not just Kubernetes.
Telemetry & Metrics
Metrics reference, Prometheus queries, Jaeger tracing