About This Project

This showcase platform itself runs on a zero-cost, fully self-hosted MLOps stack. Here's how it's built.

Zero-Cost Architecture

Every component below runs self-hosted via Docker Compose on a single IONOS instance.

Nginx

Reverse proxy + SSL + rate limiting

LiteLLM Proxy

Routing, fallbacks, caching

Qdrant

Vector search for hybrid RAG

Langfuse

Tracing & cost observability

PostgreSQL 16

Shared metadata store