How can DynamoDB be used as a sink to an AWS Data Analytics Application (Flink)?
I’m not finding examples or an existing DynamoDB Sink implementation class.
How can DynamoDB be used as a sink to an AWS Data Analytics Application (Flink)?
I’m not finding examples or an existing DynamoDB Sink implementation class.
3
Answers
There is no official DynamoDB connector for Flink.
However, there are various third party ones such as
https://github.com/klarna-incubator/flink-connector-dynamodb
Or
https://github.com/fabricalab/streaming-flink-dynamodb-connector
I would strongly suggest that you test any third party connectors to ensure they are production ready and suit your needs.
The Apache Flink community is working on it. This is the related PR.
Dynamo DB Sink connector is now available, and details available in official documentation as well.
A sample application using a custom
ElementConverter
can be found here. A sample application using theDynamoDbBeanElementConverter
can be found here.