Posts tagged "dezoomcamp"

100daysofcode 100daysofdevops 100pay 10mistakes 10yearworkanniversary 11 11labs 11tly 11ty 127001

InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch

InsightFlow GitHub RepoIn this post, we’ll explore how the data ingestion layer for the InsightFlow project was built using AWS Batch. This layer is responsible for fetching raw data from public sou...

28.04.2025 0 Read More

InsightFlow Part 4: Data Exploration & Understanding the Datasets

InsightFlow GitHub RepoBefore diving into building any data pipeline, a crucial first step is Data Exploration and Understanding. This involves getting familiar with the source datasets, their structu...

28.04.2025 0 Read More

InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow

InsightFlow GitHub RepoIn this post, we’ll dive into how the data model and schema for the InsightFlow project were designed using dbt (Data Build Tool). This layer is critical for transforming raw ...

28.04.2025 0 Read More

InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow

InsightFlow GitHub RepoIn this post, we’ll explore how AWS Glue was used to implement the ETL (Extract, Transform, Load) processes for the InsightFlow project. AWS Glue provides a serverless, fully ...

28.04.2025 0 Read More

InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow

InsightFlow GitHub RepoIn this post, we’ll explore how data quality was implemented in the InsightFlow project and share best practices for ensuring reliable and accurate data pipelines. Data qualit...

28.04.2025 0 Read More

InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow

InsightFlow GitHub RepoIn this post, we’ll explore how Amazon Athena was set up for querying and analyzing data in the InsightFlow project. Athena is a serverless, interactive query service that all...

28.04.2025 0 Read More

InsightFlow Part 9: Workflow Orchestration with Kestra

9. Workflow Orchestration with Kestra In modern data engineering, orchestrating workflows is a critical component of building reliable, scalable, and automated data pipelines. For the Insight...

29.04.2025 0 Read More

Peer Review 1: Analyzing Poland's Real Estate Market (Part 1)

Introduction Welcome to the first part of Peer Review 1 for DTC DEZOOMCAMP. This two-part series provides an in-depth review of a data engineering pipeline designed to analyze Poland's real e...

30.04.2025 0 Read More

Peer Review 1: Poland's Real Estate Market Dashboards and Insights with Streamlit (Part 2)

Introduction Welcome to the second part of Peer Review 1, where we continue exploring the data engineering project focused on analyzing Poland's real estate market. In the first post, we revi...

30.04.2025 0 Read More

Peer Review 2: TfL Station Footfall Data Analysis Pipeline (Part 1)

Peer reviews are a cornerstone of building high-quality data engineering projects. They don’t just help catch bugs and inefficiencies—they unlock opportunities for improvement, learning, and robus...

01.05.2025 0 Read More

InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch

InsightFlow Part 4: Data Exploration & Understanding the Datasets

InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow

InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow

InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow

InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow

InsightFlow Part 9: Workflow Orchestration with Kestra

Peer Review 1: Analyzing Poland's Real Estate Market (Part 1)

Peer Review 1: Poland's Real Estate Market Dashboards and Insights with Streamlit (Part 2)

Peer Review 2: TfL Station Footfall Data Analysis Pipeline (Part 1)

#reading

#popular