Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CABsXpV0ifrSEod=S396iHO9ADgpchOQtqu01yzpkkdocPH0xEQ@mail.gmail.com>
References: <CABsXpV0ifrSEod=S396iHO9ADgpchOQtqu01yzpkkdocPH0xEQ@mail.gmail.com>
From: Fabian Hueske <fhueske@gmail.com>
Date: Fri, 6 May 2016 13:47:08 +0200
Message-ID: <CAAdrtT3bfoM8jwsmb88Mq=mqPN46_pzgKWJsGkhBrK5Yb=e+9g@mail.gmail.com>
Subject: Re: OutputFormat in streaming job
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=047d7b874e5a8ed32a05322b0624
archived-at: Fri, 06 May 2016 11:47:44 -0000

--047d7b874e5a8ed32a05322b0624
Content-Type: text/plain; charset=UTF-8

Hi Andrea,

you can use any OutputFormat to emit data from a DataStream using the
writeUsingOutputFormat() method.
However, this method does not guarantee exactly-once processing. In case of
a failure, it might emit some records a second time. Hence the results will
be written at least once.

Hope this helps,
Fabian

2016-05-06 12:45 GMT+02:00 Andrea Sella <andrea.sella@radicalbit.io>:

> Hi,
>
> I created a custom OutputFormat to send data to a remote actor, there are
> issues to use an OutputFormat into a stream job? Or it will treat like a
> Sink?
>
> I prefer to use it in order to create a custom ActorSystem per TM in the
> configure method.
>
> Cheers,
> Andrea
>

--047d7b874e5a8ed32a05322b0624
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div><div>Hi Andrea,<br><br></div>you can use an=
y OutputFormat to emit data from a DataStream using the writeUsingOutputFor=
mat() method.<br></div>However, this method does not guarantee exactly-once=
 processing. In case of a failure, it might emit some records a second time=
. Hence the results will be written at least once.<br><br></div>Hope this h=
elps,<br></div>Fabian<br></div><div class=3D"gmail_extra"><br><div class=3D=
"gmail_quote">2016-05-06 12:45 GMT+02:00 Andrea Sella <span dir=3D"ltr">&lt=
;<a href=3D"mailto:andrea.sella@radicalbit.io" target=3D"_blank">andrea.sel=
la@radicalbit.io</a>&gt;</span>:<br><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=
=3D"ltr">Hi,<br><br>I created a custom OutputFormat to send data to a remot=
e actor, there are issues to use an OutputFormat into a stream job? Or it w=
ill treat like a Sink?<br><br>I prefer to use it in order to create a custo=
m ActorSystem per TM in the configure method.<br><br>Cheers,<br>Andrea</div=
>
</blockquote></div><br></div>

--047d7b874e5a8ed32a05322b0624--