I have two docker containers, one running Kafka and one running python with the Kafka client. I am attempting to set the container with the python client as a consumer for the container running Kafka. both containers are on the…
I have Java Spring Boot microservice app using Postgresql and Kafka on MacOS. There are 2 modules - filmservice and eventservice. Filmservice got kafka producer, eventservice got kafka consumer. When I try to start it in Docker container - application…
I have successfully created a mariadb database connection using debezium and kafka When I tried to stream the topic using pyspark this is the output that I get ------------------------------------------- Batch: 0 ------------------------------------------- +------+--------------------------------------------------------------------------------------------------------------------------+ |key |value | +------+--------------------------------------------------------------------------------------------------------------------------+ ||MaxDoe1.4.2.Finalnmysqlmariadbbtruebasecampemployees mysql-bin.000032�r�ȯݭd |…
We currently have an "UnwritableMetadataException" error starting Kafka in our test environment. Unfortunately, I don't know whether it is due to an incorrect configuration or something similar. Kafka is running in a Docker Container, but I don't think that's the…
I am writing my first Kafka based project and experience some issues with integration. Kafka and Kafka Connect. Here is my docker-compose.yaml version: '3.3' services: database: image: 'postgres:16.2-alpine' restart: always shm_size: 128mb ports: - 5432:5432 env_file: - ./database/.env volumes: -…
Hello guys i wanna ask some question about CDC mysql to kafka with azure database for mysql. I already following this tutorial: https://techcommunity.microsoft.com/t5/azure-database-for-mysql-blog/cdc-in-azure-database-for-mysql-flexible-server-using-kafka/ba-p/2780943 but got stuck while creating kafka conncetor on this part, and the error: {"error_code":400,"message":"Connector configuration is invalid…
CONTEXT: I have a mysql version 8 table as follows. id | field1 | field2 | ...... | field10 | timeStamp _______________________________________________________________ fieldN are float datatype. id is unique, and indexed. The values that need to go into this table…
I'm following this guide https://kafka.apache.org/quickstart to run kafka locally using docker. On step 2 I run docker pull apache/kafka:3.7.0 docker run -p 9092:9092 apache/kafka:3.7.0 Then, on step 3, I login into the container using Docker Desktop and run bin/kafka-topics.sh --create…
I'm trying to set up Change Data Capture (CDC) from a PostgreSQL database to Kafka using Debezium. I have successfully configured Debezium for CDC from a MySQL database, but I'm encountering issues when attempting to connect to a PostgreSQL database.…
I have a redpanda container which I want to use as a sink using vector when I am running this nomad job it is giving this error Feb 27 08:57:01.931 ERROR rdkafka::client: librdkafka: Global error: Resolve (Local: Host resolution failure):…