Data Engineering Guides

Last updated Sep 23, 2022 - Edit Source

• Data engineering
• Concept

Some Data Engineering Guides that will help you learn data engineering:

• Data Quality
  • How to handle data quality issues by detecting, understanding, fixing, and reduce
• Data Lake / Lakehouse Guide
  • The what & why of a Data Lake
  • Differences between Lakehouse & Data Warehouse
  • Components of a data lake
    1. Storage Layer
    2. Data Lake File Format
    3. Data Lake Table Format with Apache Parquet, Apache Iceberg, and Apache Hudi
  • Trends in the market
  • We answer questions such as:
    • How to build an open-source data lake offloading data for analytics?
    • How to govern your hundreds to thousands of files and have more database-like features?
• Reverse ETL Explained
  • A Brief Story of Data Integration: ETL vs. ELT
  • So, What is a Reverse ETL?
  • Technical Differences Between ETL and Reverse ETL
  • Typical Reverse ETL Use Cases
  • Reverse ETL and the Data Hierarchy of Needs
• Data Orchestration Trends
• Data Integration Guide
• Understanding Change Data Capture (CDC)
• Using an ETL Framework vs Writing Yet Another ETL Script

See more on Data Insights Blog Posts.