I have a kafka topic which receives messages like Kafka key: serverId value: server host name I just need the latest ones for each serverId so it's a very small segment size and log compaction is enabled. So what I…
I'm using the Wurstmeister Docker Image to try to run a very basic single broker Kafka server just for testing my application. It's a simple docker-compose.yml: version: '2' services: zookeeper: image: wurstmeister/zookeeper ports: - '2181:2181' kafka: image: wurstmeister/kafka ports: -…
It's my first Kafka program. From a kafka_2.13-3.1.0 instance, I created a Kafka topic poids_garmin_brut and filled it with this csv: kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic poids_garmin_brut kafka-console-producer.sh --broker-list localhost:9092 --topic poids_garmin_brut < "Poids(1).csv" Durée,Poids,Variation,IMC,Masse grasse,Masse…
I'm following https://github.com/PacktPublishing/Apache-Kafka-Series---Kafka-Connect-Hands-on-Learning and I've below docker-compose file and using Mac. version: '2' services: # this is our kafka cluster. kafka-cluster: image: landoop/fast-data-dev:cp3.3.0 environment: ADV_HOST: localhost # Change to 192.168.99.100 if using Docker Toolbox RUNTESTS: 0 # Disable Running tests…
I want to determine the exact version of Kafka inside confluentinc/cp-kafka:6.2.2 image. On this site, https://docs.confluent.io/platform/current/installation/versions-interoperability.html#cp-and-apache-ak-compatibility I have read that inside image with tag 6.2.x kafka version 2.8.x is being used but I want to determine the exact version of…
I get an error when I try to view topics and consumers using UI for apache kafka docker command i use: docker run -p 8080:8080 -e KAFKA_CLUSTERS_0_ZOOKEEPER=2181:2181 -e KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS=127.0.0.1:9092 -d provectuslabs/kafka-ui:latest or docker-compose.yml file services: kafka-ui: container_name: kafka-ui image: provectuslabs/kafka-ui:latest…
I'm trying to use the Kafka Exporter packaged by Bitnami, https://github.com/bitnami/bitnami-docker-kafka-exporter, together with the Bitnami image for Kafka, https://github.com/bitnami/bitnami-docker-kafka. I'm trying to run the following docker-compose.yml: version: '2' networks: app-tier: driver: bridge services: zookeeper: image: 'bitnami/zookeeper:latest' environment: - 'ALLOW_ANONYMOUS_LOGIN=yes' networks:…
I'm trying to up multiple clusters with three nodes in kafka with using docker and I followed this approach in my docker-compose file but this is wrong and I can't up Kafka those I wrote in my docker-compose file please…
I'm new to Kafka and I'm trying to run a Kafka service on my local machine and use it to transfer some data from one .NET project to another. I'm using docker-compose.yml file to create two docker containers for zookeeper…
I am trying to run multiple Kafka brokers with docker-compose. I am going to use it both in Docker network and on local machine, that's why I am using different ports for brokers: version: '3' services: zookeeper_local_dev: image: wurstmeister/zookeeper container_name:…