I'm trying to read files on s3 using Flink 1.18.1. I'm moving plugin jar to /opt/flink/plugins/s3-fs-hadoop/ in my Dockerfile. I checked it's OK the plugin is in the right folder but when I'm running my pod I have: Caused by:…
I am having trouble installing PyFlink/apache-flink 1.19.0 using python docker 3.9 - 3.12 following the official tutorial. It seems that the error is about a path that return NoneType, but I am not sure how to fix it. I did…
Why does AWS don't update their managed Flink cluster to the most updated Flink version? Is there a timeline for upgrade and if not, does it mean they don't see it as an attractive service? Is there any other managed…
I have a requirement to read the data from redis cache in flink, but as per the requirements the cache data will be refreshed on an average every two hours. I was going through the documentation and other stackoverflow questions…
as we know there's no sharing state mechanism in Flink at the moment, but I suppose we can achieve it. Suppose we have a Flink job (with a single input source) and we want to know what happened at the…
How can DynamoDB be used as a sink to an AWS Data Analytics Application (Flink)? I'm not finding examples or an existing DynamoDB Sink implementation class.
I'm calculating a simple mean on some records, using different windows sizes. Using 1 hour and 1 week windows there are no problems, and the results are computed correctly. var keyed = src .filter(event -> event.getSensor_id() < 10000) .keyBy(Event::getSensor_id); var…
We are looking to use existing redis streams in our application and process messages using Apache Flick, but could not find Redis source connector ? Any reason why Redis source connector is not available ? any constraint, is it technically…
We are comparing storm and flink. What we do is develop storm topology logic to flink app. There is using Thread.sleep(100) in the storm topology bolt, but when using in flink app, flink app performance is not good. Here is…
I'm coding a Java project to create a table within a Dockerized MySQL database using the Apache Flink API. As provided by the doc, I coded the following lines of code in order to define a streaming environment: StreamExecutionEnvironment env…