Posts tagged "dataengineering"

100daysofcode 100daysofdevops 100pay 10mistakes 10yearworkanniversary 11 11labs 11tly 11ty 127001

How Pandas Simplifies ETL Data Cleaning

When discussing the "T" in the ETL (Extract, Transform, Load) process, a huge part of the work involves cleaning the data and ensuring it is ready for analysis. If you're a data engineer, you've proba...

11.04.2025 0 Read More

Building a Scalable Data Architecture with Apache Tools: A Free and Open-Source Solution

In today's data-driven world, organizations need a robust and scalable data architecture to handle large volumes of data. Apache offers a suite of free and open-source tools that can help build a comp...

13.04.2025 0 Read More

Get the Records after and before the Searched One — From SQL to SPL #18

Problem description & analysis: The ProductionLine_Number in a certain table of the Mariadb database is a grouping field, and there are duplicate values in the Cardboard_Number field with...

13.04.2025 0 Read More

Apache Airflow for Data Engineering: Best Practices and Real-World Examples

Introduction Apache Airflow is a piece of open sourced orchestration software, originally developed at Airbnb and now part of the apache software foundation, that provides functionality for a...

14.04.2025 0 Read More

SQL for Beginners - A Complete Guide.

Introduction Structured Query Language (SQL) is a language that is used to interact with SQL databases. In today's data-driven world, data professionals e.g. data analysts, data engineers, da...

14.04.2025 0 Read More

Learn Python Basics for Data Engineering (with Mini Project)

In today’s data-driven world, Data Engineers are the architects of pipelines that move and transform data. Python has emerged as a key language for data engineering due to its simplicity, easy to i...

14.04.2025 0 Read More

Create, Read, Update, Delete (CRUD) | MongoDB Tutorial 2025

Table of Contents Introduction to MongoDB Installation & Database Creation CRUD Operations (You are here). Embedded Documents and Arrays Introduction to CRUD Operations in Mong...

14.04.2025 0 Read More

Personal Picks: Data Product News (April 16, 2025)

Note: This is an English translation of this original Japanese article.Hello, this is Sagara.As a Modern Data Stack consultant, I've noticed that there's a constant flow of information in the Modern D...

15.04.2025 0 Read More

Databricks Asset Bundle: A Template to Make Life Easier

If you're working with data pipelines on Databricks, you know how time-consuming it can be starting from scratch with each new project. That's why I've put together this Databricks Asset Bundle (DAB) ...

15.04.2025 0 Read More

Find the Superset from the Relationship Table — From SQL to SPL #19

Problem description & analysis: The MySQL database has two tables: bag table and bag item relationship table. Some bags are supersets of other bags.bagbag_itemTask: Now we need to find th...

15.04.2025 0 Read More

How Pandas Simplifies ETL Data Cleaning

Building a Scalable Data Architecture with Apache Tools: A Free and Open-Source Solution

Get the Records after and before the Searched One — From SQL to SPL #18

Apache Airflow for Data Engineering: Best Practices and Real-World Examples

SQL for Beginners - A Complete Guide.

Learn Python Basics for Data Engineering (with Mini Project)

Create, Read, Update, Delete (CRUD) | MongoDB Tutorial 2025

Personal Picks: Data Product News (April 16, 2025)

Databricks Asset Bundle: A Template to Make Life Easier

Find the Superset from the Relationship Table — From SQL to SPL #19

#reading

#popular