I am new to kafka connector. I have been explore about it about a week. I have used create and update the mongodb via mongodb connector curl commands. I am bit struggling to understand the concept and implementation of below.…
I have mongodb and I need to send the changes from a certain query to kafka broker. I heard that debezium tracks changes from database and stores it to kafka. But is there a way to configure that process to…
I am required by our client to run Apache Kafka in linux container on Windows Server 2019 with LCOW. I am using docker-compose to bring up two containers and this is my docker-compose.yml file: version: "3" services: zookeeper: image: 'bitnami/zookeeper:latest'…
There are client, kafka and zookeeper in the same network, I am trying to connect from client to kafka with SERVICE_NAME:PORT but driver-service-container | 2022-07-24 09:00:05.076 WARN 1 --- [| adminclient-1] org.apache.kafka.clients.NetworkClient : [AdminClient clientId=adminclient-1] Connection to node 1 (localhost/127.0.0.1:9092)…
I've 3 brokers containers and 1 zookeeper container running in a docker stack, both zookeeper container and brokers containers keeps stopping after some days (less than a week) running in an idle state. This is one of the brokers logs…
In our applications have enabled exactly-once in both Producer and Consumer. Producer is a python component.We have enabled: idempotence use transactions (new transactionId is used every time when we send messages) Consumer is a Spring Boot application. We have enabled:…
I'm calculating a simple mean on some records, using different windows sizes. Using 1 hour and 1 week windows there are no problems, and the results are computed correctly. var keyed = src .filter(event -> event.getSensor_id() < 10000) .keyBy(Event::getSensor_id); var…
I am running Kafka inside a container and would like to be able to run a simple command to change the number of partitions on a topic from Java application (Spring-Boot). I have tried with ProcessBuilder but from what I…
I following the Kafka quick start guide. I'm stuck as step 6 though, Import/Export your data as streams of Events... https://kafka.apache.org/documentation/ The error indicates that Kafka can't find the connector. I've added it to the connect-standalone.properties file in a variety…
I have a Kafka Consumer service @KafkaListener( topics = "topic1", groupId = "cluster1", containerFactory = "KafkaListenerContainerFactory") public void consume(Message message) { logger.info(String.format("Message recieved -> %s", message.getMsg())); Long id = message.getId() RepoDetail repoDetail = testRepo.findByID(id); logger.info( String.format( "Message -> %s", repoDetail.getMessage()));…