There are client, kafka and zookeeper in the same network, I am trying to connect from client to kafka with SERVICE_NAME:PORT but driver-service-container | 2022-07-24 09:00:05.076 WARN 1 --- [| adminclient-1] org.apache.kafka.clients.NetworkClient : [AdminClient clientId=adminclient-1] Connection to node 1 (localhost/127.0.0.1:9092)…
I've 3 brokers containers and 1 zookeeper container running in a docker stack, both zookeeper container and brokers containers keeps stopping after some days (less than a week) running in an idle state. This is one of the brokers logs…
In our applications have enabled exactly-once in both Producer and Consumer. Producer is a python component.We have enabled: idempotence use transactions (new transactionId is used every time when we send messages) Consumer is a Spring Boot application. We have enabled:…
I'm calculating a simple mean on some records, using different windows sizes. Using 1 hour and 1 week windows there are no problems, and the results are computed correctly. var keyed = src .filter(event -> event.getSensor_id() < 10000) .keyBy(Event::getSensor_id); var…
I am running Kafka inside a container and would like to be able to run a simple command to change the number of partitions on a topic from Java application (Spring-Boot). I have tried with ProcessBuilder but from what I…
I following the Kafka quick start guide. I'm stuck as step 6 though, Import/Export your data as streams of Events... https://kafka.apache.org/documentation/ The error indicates that Kafka can't find the connector. I've added it to the connect-standalone.properties file in a variety…
I have a Kafka Consumer service @KafkaListener( topics = "topic1", groupId = "cluster1", containerFactory = "KafkaListenerContainerFactory") public void consume(Message message) { logger.info(String.format("Message recieved -> %s", message.getMsg())); Long id = message.getId() RepoDetail repoDetail = testRepo.findByID(id); logger.info( String.format( "Message -> %s", repoDetail.getMessage()));…
I am running a docker file to execute a debezium service as entrypoint. It works fine and executes debezium service when I use the exact file path as parameter to Entrypoint command in my docker file command in docker file…
I have a docker-compose.yml file: version: '2' services: zookeeper: image: confluentinc/cp-zookeeper:latest environment: ZOOKEEPER_CLIENT_PORT: 2181 ZOOKEEPER_TICK_TIME: 2000 ports: - 2181:2181 kafka: image: confluentinc/cp-kafka:latest depends_on: - zookeeper ports: - 9092:9092 environment: KAFKA_BROKER_ID: 1 KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://broker:29092,PLAINTEXT_HOST://localhost:9092 KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT KAFKA_INTER_BROKER_LISTENER_NAME: PLAINTEXT KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR:…
I installed PHP 7.4 and RdKafka by using PECL however the module didn't start, here is the output of php -v PHP Warning: PHP Startup: rdkafka: Unable to initialize module Module compiled with module API=20210902 PHP compiled with module API=20190902…