Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration

Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Oll...

Open Source AI Platform - AI Chat with advanced features that works with every LLM

Intelligent Mixture-of-Models Router for Efficient LLM Inference

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, pla...

Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.

Web UI for Karmada

DeepSeek Harness: Everything is a Plugin.