#databricks Development Tutorials & Tips | Roast Dev

Databricks Platform: Unlocking Big Data Analytics and Machine Learning at Scale

Are you looking to harness the full power of big data analytics and cloud-based data processing? The Databricks platform has emerged as a leading solution for organizations seeking to transform their ...

11.03.2025 0 Read More

Unlocking Data Governance at Scale with Databricks Unity Catalog

In today's data-driven world, organizations face the dual challenge of democratizing data access while maintaining strict governance controls. Enter Databricks Unity Catalog—a unified governance sol...

16.03.2025 0 Read More

🍏 Eat 5 Fruits and Vegetables a Day… and What About Our Data? 🤔

We always hear the health advice: "Eat 5 fruits and vegetables a day!" 🍎🍌🥦 It’s good for our health, keeps us fit, and gives us energy. But what if we applied this logic to data management?...

18.03.2025 0 Read More

Databricks Optimistic Concurrency Control: Enabling Efficient Collaboration in Big Data Environments

As organizations increasingly adopt data-driven approaches to solve complex business problems, the need for collaborative data engineering and analytics platforms has never been greater. Databricks, a...

20.03.2025 0 Read More

Unlocking the Power of Delta Lake UNIFORM in Databricks

Organizations are constantly seeking more efficient ways to manage their big data ecosystems. If you're working with data lakes, data warehouses, or the increasingly popular data lakehouse architectur...

22.03.2025 0 Read More

Optimizing Data Sync from PostgreSQL to Databricks with Fivetran

In my previous work as a Platform Engineer for a remittance company, we faced a significant issue related to costs. Our Fivetran syncs were consuming an excessive amount of Databricks cluster resource...

27.03.2025 0 Read More

Unraveling Data Mysteries: A Tale of Missing Values in Customer Churn Prediction

As a Senior Machine Learning Engineer working on a customer churn prediction model at a bustling tech company, I recently encountered a puzzling situation that turned into an insightful journey. Our t...

01.04.2025 0 Read More

Best warehouse-native analytics tools

What is warehouse-native analytics? Warehouse-native analytics operates your data directly on top of your data warehouse instead of moving it to third-party tools for processing. Traditionall...

01.04.2025 0 Read More

AI - DBRX - Databricks - Documentando automaticamente suas tabelas e colunas do Unity Catalog

Fala galera de Data, espero que todos estejam bem e acompanhando essa nova era da tecnologia que estamos vivenciando e desta forma nada melhor do que surfar nesse tsunami do que deixar ele te atingir ...

05.04.2025 0 Read More

Feature Engineering para Embeddings com SparkML e MLFlow no Databricks Experiments

Hoje resolvi relembrar alguns conceitos de machine learning e entre eles a parte de vetorização de categorias para ter um dataset mais apto para deep learning (Redes neurais). Portanto neste artigo ...

06.04.2025 0 Read More