#bigdata Development Tutorials & Tips | Roast Dev

100daysofcode 100daysofdevops 100pay 10mistakes 10yearworkanniversary 11 11labs 11tly 11ty 127001

🐼 Pandas Too Slow? Try These Fast Python Libraries for Data Analysis

Pandas is great — until it crashes with large data. Here’s what to use instead 🚀In my latest post, I explore modern, high-performance Python libraries that can handle huge datasets faster and m...

21.03.2025 0 Read More

🚀 Kyuubi + Apache Spark: Big Data, Smarter Execution

Kyuubi supercharges Spark SQL with resource isolation, multi-user support, interactive performance, and high availability.No more: Cluster-wide slowdowns from one heavy query ☠️ Missing security c...

21.03.2025 0 Read More

Mastering Big Data with GCP: My Capstone Journey in Cloud Data Analysis

Introduction As a data enthusiast, I’ve always been fascinated by the power of cloud platforms to transform raw data into actionable insights. Recently, I completed a capstone project using...

25.03.2025 0 Read More

Building an Efficient and Cost-Effective Business Data Analytics System with Databend Cloud

With the rise of large AI models such as OpenAI's ChatGPT, DeepL, and Gemini, the traditional machine translation field is being disrupted. Unlike earlier tools that often produced rigid translations ...

28.03.2025 0 Read More

A Deep Dive into Apache Doris Indexes

A Deep Dive into Apache Doris Indexes Developers in the big data field know that quickly retrieving data from a vast amount of information is like searching for a specific star in the constel...

31.03.2025 0 Read More

Is Storage-Computing Separation Really Necessary? From the Architectural Debate to the Practical Analysis of Doris

Introduction: A Decade-Long Debate on “Storage and Computing” In the field of databases and big data, the architectural debate between “storage-computing integration” and “storage-c...

31.03.2025 0 Read More

Apache Pyspark

It is a fast and general-purpose distributed computing system for big data processing. It provides an in-memory computation model, which significantly improves performance over traditional disk-based ...

31.03.2025 0 Read More

Architecting High-Performance Data Pipelines with Modern ETL | Spiral Mantra

Key Technologies Used: Apache Airflow & Dagster – Workflow orchestration with DAG-based dependencies.Spark & dbt (Data Build Tool) – Optimized transformations for big data analytics.Kafka ...

01.04.2025 0 Read More

Desire for Structure (read “SQL”)

Or obsession for control?Let’s admit it: we love the idea of running SQL queries on ALL our data! Not just a preference — it feels like an obsession. No matter how old or how rarely accessed, we c...

03.04.2025 0 Read More

(Beyond) The Art of Database Indexing

and Why Indexes Alone Won’t Save You Executive Summary Modern databases handle vast amounts of data — often spanning tens of terabytes or even petabytes — and relying solely on indexing ...

03.04.2025 0 Read More

🐼 Pandas Too Slow? Try These Fast Python Libraries for Data Analysis

🚀 Kyuubi + Apache Spark: Big Data, Smarter Execution

Mastering Big Data with GCP: My Capstone Journey in Cloud Data Analysis

Building an Efficient and Cost-Effective Business Data Analytics System with Databend Cloud

A Deep Dive into Apache Doris Indexes

Is Storage-Computing Separation Really Necessary? From the Architectural Debate to the Practical Analysis of Doris

Apache Pyspark

Architecting High-Performance Data Pipelines with Modern ETL | Spiral Mantra

Desire for Structure (read “SQL”)

(Beyond) The Art of Database Indexing

#reading

#popular