A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
Marketplace
Independent
Category
engineering
More like this
Browse engineering agents →
Refrax
Command-Line Agentic Refactoring of Java Code
Free
engineeringOpencode Plan Manager
A simple collection of tools for better plan management by AI agents on OpenCode.
Free
engineeringTabnine
Privacy-first AI code completion for enterprise teams
$12/mo
engineeringKitwork
Automate kit workflows effortlessly with a lightweight, high-performance, fast, and flexible engine for cloud or self-hosted environments.
Free