ETL/ELT Pipeline Data Engineering Projects
Data movement and transformation workflows
Discover open-source data engineering projects in ETL/ELT Pipeline from the community.
17 projects found
1.UFC Data Warehouse
UFC Data Warehouse and dashboards based on up-to-date data
2.Silism Commerce 360 - Local AI Native Lakehouse
AI-native e-commerce data platform you can run locally (Airflow + dbt + MCP)
3.AIRFLow Medical Data Pipeline
Enterprise-grade ETL pipeline transforming medical XML data into actionable business intelligence
4.Bluesky NBA Real-Time Sentiment Analysis
A real-time data streaming pipeline that captures live posts from Bluesky regarding the NBA, perform
5.Yelp Batch ETL Pipeline
A batch ETL pipeline that processes Yelp business raw data to generate analytics and insights
6.Airflow and DBT Analytics Accelerator
An Open-source accelerator for a ready-to-run, end-to-end analytics platform
7.Yelp Medallion Batch Pipeline
Building medallion architecture for crowd-sourced reviews using Snowflake native features
8.Smart Wardrobe Suggestion
LLM Based Smart Clothing Suggestion
9.Reddit ETL Pipeline in Docker
Reddit Data Engineering ETL Pipeline: Spark, Airflow, MinIO in Docker Medallion Architecture
10.Flink Sales Pipeline
Real-Time E-Commerce Sales Analytics Pipeline
11.Baskpipe
Fully AWS-native data pipelines for processing basketball (NBA) data.
12.Github Stars Monitor
Never miss a new top starred repository
13.Macro Agents Economic Data Platform
From FRED to Forecasts: A Modern Data Stack for Economic Intelligence
14.F1 Insights Real Time Replay
What if your dashboards were as realtime as Max vestappen!
15.Batch data pipeline
Batch Data Pipeline with Airflow, DuckDB, Delta Lake, Trino and Metabase. Observability and quality.
16.Automated News Intelligence Pipeline
An end-to-end automated pipeline for collecting, processing, and analyzing news articles with machin
17.AIRFLOW YAHOO ETL
SCALABLE_YAHOO_API_ETL_PIPELINE_USING_AIRFLOW