change-data-feed

Data decoding, encoding, conversion, and translation utilities.

Databricks App for VIN and symptom search over NHTSA vehicle safety data. Streamlit frontend on an agent with four tools that read complaints and recalls and write records back to Delta.

A concise handbook covering Databricks architecture, Delta Lake, Unity Catalog, and data engineering best practices for building scalable and production-ready data pipelines.

Production-style Databricks Lakehouse Medallion Pipeline using PySpark, Delta Lake, CDC, SCD2, Data Quality, Reliability Testing, Monitoring and Performance Tuning.

Medallion Architected data pipeline