Through a Rest API endpoint, I accept JSON and using a Kafka Producer, I publish the JSON to a topic. The JSON will have this format: { "id": "uniqueIdentifier", "name": "PersonName", "age": PersonAge } and the send message method in…
I am getting error while connecting to kafka..Below are some lines of error It is an spring boot application 2024-02-21T14:02:03.419Z INFO 1 --- [customer-master-service] [ main] [ ] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=consumer-customer-master-service-kafka-group-6, groupId=customer-master-service-kafka-group] Subscribed to topic(s): CAS_CUSTOMER_UPDATE 2024-02-21T14:02:03.461Z INFO 1…
I'm having authentication issues when I try to connect a producer following the instruction of the helm chart installation: I'm installing this kafka helm chart: https://artifacthub.io/packages/helm/bitnami/kafka?modal=install I can perfectly install it with helm install, and this is the output from…
There are client, kafka and zookeeper in the same network, I am trying to connect from client to kafka with SERVICE_NAME:PORT but driver-service-container | 2022-07-24 09:00:05.076 WARN 1 --- [| adminclient-1] org.apache.kafka.clients.NetworkClient : [AdminClient clientId=adminclient-1] Connection to node 1 (localhost/127.0.0.1:9092)…
In our applications have enabled exactly-once in both Producer and Consumer. Producer is a python component.We have enabled: idempotence use transactions (new transactionId is used every time when we send messages) Consumer is a Spring Boot application. We have enabled:…
I have a Kafka Consumer service @KafkaListener( topics = "topic1", groupId = "cluster1", containerFactory = "KafkaListenerContainerFactory") public void consume(Message message) { logger.info(String.format("Message recieved -> %s", message.getMsg())); Long id = message.getId() RepoDetail repoDetail = testRepo.findByID(id); logger.info( String.format( "Message -> %s", repoDetail.getMessage()));…
I'm using two microservices in order to communicate with each other using Kafka. On one microservice there is the listener, and on the other microservice, the sender. The problem is that whenever producer sends a message, consumer will get 20…
I have a kafka topic which receives messages like Kafka key: serverId value: server host name I just need the latest ones for each serverId so it's a very small segment size and log compaction is enabled. So what I…