Posts tagged "kafka"

100daysofcode 100daysofdevops 100pay 10mistakes 10yearworkanniversary 11 11labs 11tly 11ty 127001

Study Notes 6.13-14: Kafka Streaming with Python & PySpark Structured Streaming with Kafka

1. Overview of Kafka Streaming with Python Purpose & Context: This session demonstrates how to implement Kafka streaming applications using Python, mirroring the producer–consumer examp...

18.03.2025 0 Read More

Study Notes 6.15: Kafka & Flink Streaming

1. Introduction to Kafka Streaming with PyFlink Streaming Data Processing: Involves the continuous ingestion, processing, and movement of data in real time. Critical for use cases where i...

18.03.2025 0 Read More

Custom User AUTH/Z for Strimzi Kafka: Integrating Your Corporate CERTIFICATE AUTHORITY Certs with Strimzi KAFKA

Integrating your organization’s Certificate Authority (CA) with Strimzi Kafka is essential for enforcing user-level authentication and authorization (AUTH/Z) in corporate environments. Strimzi’s d...

22.03.2025 0 Read More

Received request api key METADATA with version 6 which is not enabled

ERROR Closing socket for 10.240.200.113:9093-10.240.200.113:46900-3 because of error (kafka.network.Processor) org.apache.kafka.common.errors.InvalidRequestException: Received request api key METADATA...

24.03.2025 0 Read More

[Tiny] You Don’t Need @EnableKafka... Or Do You?

This week, I learned that when we use Kafka, the @EnableKafka annotation is not needed if an application is a Spring Boot application. We only need it if we are developing with Spring, not Spring Boot...

27.03.2025 0 Read More

Kafka Producer Stability Check: Ensuring Message Safety in Apache Kafka

During a recent incident, our team observed message loss from a Kafka producer during an Amazon MSK rolling patch. What began as a routine upgrade quickly uncovered hidden weaknesses in our producer's...

04.05.2025 0 Read More

Integration Digest for April 2025

Articles 🔍 10 API Linters and Description ValidatorsThis article offers an overview of various API linting and validation tools. It covers both AI-enhanced solutions like LintGPT and speci...

04.05.2025 0 Read More

Configuring Fluentd to Collect Data from Azure Event Hub

This guide covers setting up Fluentd to fetch data from Azure Event Hub using Kafka Fluentd plugin. Table of Contents Prerequisites Understanding Azure Event Hub What is Fluentd? Setting Up ...

30.03.2025 0 Read More

Install Kafka+Zookeeper using Docker container in Windows

The article is about how to install Single Node multiple broker setup of Kafka and Zookeeper. This process is faster compared to installing kafka and zookeeper directly in Windows machine as both inst...

31.03.2025 0 Read More

Integration Digest: March 2025

Articles 🔍 2025 State of Internal Developer PortalsThis report details the current challenges faced by engineering teams regarding internal developer portals. It outlines issues such as to...

01.04.2025 0 Read More