Silism Commerce 360 - Local AI Native Lakehouse

Silism Commerce 360 is a full-featured, AI-native data platform that simulates how a real e-commerce company ingests, transforms, observes, and analyzes data.

It brings together:

• Modern data engineering: dltHube, dbt, Airflow(Astro), DuckDB, Kafka

• AI-native interfaces: MCP server + local LLM (Ollama)

• Real-time analytics UI: Streamlit dashboard

• Production-grade observability: Prometheus, Grafana, Loki, Jaeger

• Containerized orchestration: Docker + Docker Compose

Designed as a reference architecture to learn or showcase:

• Lakehouse design patterns (local-first)

• Batch + streaming pipelines

• End-to-end observability

• AI-assisted analytics workflows

• A “run it on your laptop” platform demo (zero cloud cost)

Run it locally in minutes and use it as a portfolio project, a team demo, or a learning playground.

Articles about the project:
- https://silism.com/building-a-production-grade-e-commerce-analytics-platform-a-journey-into-modern-data-engineering-part-1/
- https://silism.com/building-a-production-grade-e-commerce-analytics-platform-a-journey-into-modern-data-engineering-part-2/