flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From M Singh <mans2si...@yahoo.com.INVALID>
Subject Re: Guide for Flink Source/Sinks
Date Tue, 10 May 2016 12:31:11 GMT
Thanks Till for the pointers.

    On Tuesday, May 10, 2016 1:07 AM, Till Rohrmann <trohrmann@apache.org> wrote:

 Hi Mans,there is no explicit guide for how to write a custom source/sink as far as I know.
There is just a paragraph in the data sources section (https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/#data-sources).For
sources you have to implement the SourceFunction interface for non parallel sources or the
ParallelSourceFunction for parallel sources. If you need access to the RuntimeContext, then
you should extend the RichParallelSourceFunction. Be aware, that you should always emit elements
to the downstream operator when you hold the checkpoint lock. You emit and obtain the checkpoint
lock from the SourceContext.For custom sinks you have to implement the SinkFunction or the
ParallelSinkFunction.I hope this gets you started :-)Cheers,
On Mon, May 9, 2016 at 11:54 PM, M Singh <mans2singh@yahoo.com.invalid> wrote:

Hi Folks:
I am new to Flink and wanted to find out if there is a guide to how to create new sources/sinks
for Flink.
I tried browsing through the documentation but did not find a single place with all the interfaces/etc
Thanks for your help.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message