End-to-end Medallion (Bronze-Silver-Gold) pipeline for airline booking analytics, built entirely on Azure Data Factory. Ingests data from Azure SQL DB, a REST API, and on-prem CSV files into ADLS Gen2, with watermark-based incremental loads, producing ranked Gold views like Top Airlines by Sales and Top Flights by Revenue.
github devops rest-api csv-files pipelines facts dataflow datasets cicd adf onprem watermark azuredevops github-actions azuresqldatabase adls-gen2 dimensions-data
-
Updated
Sep 2, 2026