flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: Guide for Flink Source/Sinks
Date Tue, 10 May 2016 08:07:41 GMT
Hi Mans,

there is no explicit guide for how to write a custom source/sink as far as
I know. There is just a paragraph in the data sources section (
https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/#data-sources
).

For sources you have to implement the SourceFunction interface for non
parallel sources or the ParallelSourceFunction for parallel sources. If you
need access to the RuntimeContext, then you should extend the
RichParallelSourceFunction. Be aware, that you should always emit elements
to the downstream operator when you hold the checkpoint lock. You emit and
obtain the checkpoint lock from the SourceContext.

For custom sinks you have to implement the SinkFunction or the
ParallelSinkFunction.

I hope this gets you started :-)

Cheers,
Till
‚Äč

On Mon, May 9, 2016 at 11:54 PM, M Singh <mans2singh@yahoo.com.invalid>
wrote:

> Hi Folks:
> I am new to Flink and wanted to find out if there is a guide to how to
> create new sources/sinks for Flink.
> I tried browsing through the documentation but did not find a single place
> with all the interfaces/etc required.
> Thanks for your help.
> Mans

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message