flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pradeep s <sreekumar.prad...@gmail.com>
Subject Flink to S3 streaming
Date Sat, 08 Apr 2017 06:09:19 GMT
I have a use case to stream messages from Kafka to Amazon S3. I am not
using the s3 file system way since i need to have Object tags to be added
for each object written in S3.
So i am planning to use the AWS S3 sdk . But i have a query on how to hold
the data till the message size is in few MBs and then write to S3.Also what
should be sink to be used in this case if i am using S3 sdks to write to S3.
Pradeep S

View raw message