data-engineer-roadmap

Fundamentals

• Data Structures and Algorithms
• Structured and Unstructured Data

Programming

• Programming Languages
• Libraries
• Notebooks

Relational Database

• Database concepts
• Data manipulation language (DML)
• Data definition language (DDL)
• Database objects
• Data storage
• Partitioning
• Database security

Non-relational databases

• Document
• Key-value
• Graph
• Column family

Big Data

• About Big Data

Data Formats

• Tabular
• Row-Based
• Columnar
  • Vectorized query execution
• Data Interchange
• Statistical

Data Modeling

• N3F
• Dimensional Model (Star Schema)
• Data Vault

Data Warehouse

• Arquitecture
• ETL
• Data Mart

Storage

• Concepts
• Object vs File vs Block
• Data Lake
• Cloud storage

Data Lakehouse

• Features
• Cloud Solutions

Analytics

• Self-service BI

Data Processing

• Batch Processing
• Real-time processing
• Online Processing
• Multiprocessing
• Time-sharing

Messaging

• Streaming
• Queue

Monitoring

• IoT
• Pipelines
• Golden Signals

CI/CD

• Git
• DevOps

Data Governance

• Catalog
• Data Quality