Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <1465224812924-7405.post@n4.nabble.com>
References: <1465201837278-7392.post@n4.nabble.com> <CAKiyyaH1+8r0xVK5Q1XHmZjAiZEiryD1MxCpgE93vMiYRAUBBQ@mail.gmail.com>
 <1465224812924-7405.post@n4.nabble.com>
From: Fabian Hueske <fhueske@gmail.com>
Date: Thu, 9 Jun 2016 17:12:34 +0200
Message-ID: <CAAdrtT3hzK77xGHbDCMcSOH2Hcn0qgiac+r5BJDpjGvYfA6hPg@mail.gmail.com>
Subject: Re: Data Source Generator emits 4 instances of the same tuple
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a114732e4cb7ce80534d9dbaa
archived-at: Thu, 09 Jun 2016 15:13:10 -0000

--001a114732e4cb7ce80534d9dbaa
Content-Type: text/plain; charset=UTF-8

We solved this problem yesterday at the Flink Hackathon.
The issue was that the source function was started with parallelism 4 and
each function read the whole file.

Cheers, Fabian

2016-06-06 16:53 GMT+02:00 Biplob Biswas <revolutionisme@gmail.com>:

> Hi,
>
> I tried streaming the source data 2 ways
>
> 1. Is a simple straight forward way of sending data without using the
> serving speed concept
> http://pastebin.com/cTv0Pk5U
>
>
> 2. The one where I use the TaxiRide source which is exactly similar except
> loading the data in the proper data structures.
> http://pastebin.com/NenvXShH
>
>
> I hope to get a solution out of it.
>
> Thanks and Regards
> Biplob Biswas
>
>
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-Source-Generator-emits-4-instances-of-the-same-tuple-tp7392p7405.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

--001a114732e4cb7ce80534d9dbaa
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>We solved this problem yesterday at the Flink Ha=
ckathon.<br></div>The issue was that the source function was started with p=
arallelism 4 and each function read the whole file.<br><br></div>Cheers, Fa=
bian<br></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">201=
6-06-06 16:53 GMT+02:00 Biplob Biswas <span dir=3D"ltr">&lt;<a href=3D"mail=
to:revolutionisme@gmail.com" target=3D"_blank">revolutionisme@gmail.com</a>=
&gt;</span>:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8e=
x;border-left:1px #ccc solid;padding-left:1ex">Hi,<br>
<br>
I tried streaming the source data 2 ways<br>
<br>
1. Is a simple straight forward way of sending data without using the<br>
serving speed concept<br>
<a href=3D"http://pastebin.com/cTv0Pk5U" rel=3D"noreferrer" target=3D"_blan=
k">http://pastebin.com/cTv0Pk5U</a><br>
<br>
<br>
2. The one where I use the TaxiRide source which is exactly similar except<=
br>
loading the data in the proper data structures.<br>
<a href=3D"http://pastebin.com/NenvXShH" rel=3D"noreferrer" target=3D"_blan=
k">http://pastebin.com/NenvXShH</a><br>
<br>
<br>
I hope to get a solution out of it.<br>
<span class=3D""><br>
Thanks and Regards<br>
Biplob Biswas<br>
<br>
<br>
<br>
<br>
<br>
--<br>
</span>View this message in context: <a href=3D"http://apache-flink-user-ma=
iling-list-archive.2336050.n4.nabble.com/Data-Source-Generator-emits-4-inst=
ances-of-the-same-tuple-tp7392p7405.html" rel=3D"noreferrer" target=3D"_bla=
nk">http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Dat=
a-Source-Generator-emits-4-instances-of-the-same-tuple-tp7392p7405.html</a>=
<br>
<div class=3D"HOEnZb"><div class=3D"h5">Sent from the Apache Flink User Mai=
ling List archive. mailing list archive at Nabble.com.<br>
</div></div></blockquote></div><br></div>

--001a114732e4cb7ce80534d9dbaa--