When there are updates done to an underlying topic of a GlobalKTable, what is the logic for all instances of KStream apps to get the latest data? Below are my follow up questions: Would the GlobalKTable be locked at record…
I have this problem using centos 7 the problem is when i try to connect with ssl and I'am using local internet provider the handshaking will block after client hello, openssl version: OpenSSL 1.1.0g 2 Nov 2017 openssl s_client -connect…
I’m building a system for playing cards, and I’ve decided on a pub/sub system using SSE to keep the clients updated. A problem I’m facing is keeping messages around for later querying. One use case is a player joins a…
I am attempting to setup confluent kafka v5.4 and running the prometheus JMX exporter. I have found this blog for how to get this setup https://alex.dzyoba.com/blog/jmx-exporter/ . Kafka is setup and runs just fine but the endpoint on port 8080…
Paths are correct, I don't know why I can't start kafka service, all lines, log files, etc and do not say what the Issue is... :/ I'm trying to install kafka on my Centos 7/8 and there is no Issue…
I am using github.com/Shopify/sarama package to interact with Kafka. In my current approach I could connect to the broker and get all topic names without a problem (Consumer Code below). However, when I try to delete some topic using the…
I have a stream of events i need to match against a ktable / changelog topic but the matching is done by pattern matching on a property of the ktable entries. so i cannot join the streams based on a…
I am trying to replicate Kafka cluster with MirrorMaker 2.0. I am using following mm2.properties: name = mirror-site1-site2 topics = .* connector.class = org.apache.kafka.connect.mirror.MirrorSourceConnector tasks.max = 1 plugin.path=/usr/share/java/kafka/plugin clusters = site1, site2 # for demo, source and target clusters are…
I read the consumer group example in here(provided by Shopify/sarama), and I wonder that how would I know how many consumers are in a consumer group, are there any ways I could control the number of consumers? Thanks a lot
We have a 3 node Kafka cluster deployment with 5 topics and 6 partitions per topic. we have configured the replication factor =3 , we are seeing very strange problem that number of file descriptor have been crossed the ulimit…