#dataengineering Development Tutorials & Tips | Roast Dev

100daysofcode 100daysofdevops 100pay 10mistakes 10yearworkanniversary 11 11labs 11tly 11ty 127001

Calculate a Pair of Minimum Values that Meet the Criteria within the Group — From SQL to SPL #12

Problem description & analysis: A table stores events that occur for multiple accounts on multiple dates.Task: Now we need to find a pair of events that meet the criteria under each accou...

23.03.2025 0 Read More

Received request api key METADATA with version 6 which is not enabled

ERROR Closing socket for 10.240.200.113:9093-10.240.200.113:46900-3 because of error (kafka.network.Processor) org.apache.kafka.common.errors.InvalidRequestException: Received request api key METADATA...

24.03.2025 0 Read More

OLAP vs OLTP: The war that is not meant to be

In previous articles, we covered what OLTP and OLAP are, their benefits, key features, and use cases. This might make it seem like there's a 'fight' or 'battle' between these technologies, but that’...

25.03.2025 0 Read More

Pair and Transpose Adjacent Records within the Group - From SQL to SPL #13

Problem description & analysis: A certain table stores records of personnel from external sources entering and leaving a building by swiping their cards in recent days. When a person ente...

25.03.2025 0 Read More

Software and Data Engineering: How They Power AI and Big Data

Data powers the world, but engineering makes it useful. Software engineering builds the systems we rely on, while data engineering ensures smooth data flow and large-scale processing. They form the fo...

26.03.2025 0 Read More

SQLite Database GUI Tool | Design and Visualize with DbSchema

If you are looking for a way to design and manage your SQLite database, DbSchema helps you create clear database diagrams, edit your schema visually, and generate SQL scripts. With an intuitive interf...

26.03.2025 0 Read More

Amazon Redshift Data Warehousing (Sample Project)

Overview This project focuses on analyzing two key business processes using Amazon Redshift: Identifying the most common frequency of purchases per season. Finding products with high review r...

26.03.2025 0 Read More

Azure Data Factory

It is a cloud-based ETL (Extract, Transform, Load) service designed for serverless data integration and transformation at scale. Key Features: Serverless Data Integration: Automates and orch...

26.03.2025 0 Read More

Stop flattening your JSON just to export it to Excel

If you've ever needed to share structured Python data (like nested dicts or lists) with non-developers, chances are you've hit this classic wall: Can you export that to Excel? And suddenly, you're fig...

27.03.2025 0 Read More

Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL

Introduction This article details creating an automated ETL (Extract, Transform, Load) pipeline that retrieves daily Bitcoin price data from the Polygon.io API, performs necessary transformat...

31.03.2025 0 Read More

Calculate a Pair of Minimum Values that Meet the Criteria within the Group — From SQL to SPL #12

Received request api key METADATA with version 6 which is not enabled

OLAP vs OLTP: The war that is not meant to be

Pair and Transpose Adjacent Records within the Group - From SQL to SPL #13

Software and Data Engineering: How They Power AI and Big Data

SQLite Database GUI Tool | Design and Visualize with DbSchema

Amazon Redshift Data Warehousing (Sample Project)

Azure Data Factory

Stop flattening your JSON just to export it to Excel

Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL

#reading

#popular