Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Message-ID: <55910FCB.3010604@informatik.hu-berlin.de>
Date: Mon, 29 Jun 2015 11:28:43 +0200
From: "Matthias J. Sax" <mjsax@informatik.hu-berlin.de>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:31.0) Gecko/20100101 Icedove/31.7.0
MIME-Version: 1.0
To: dev@flink.apache.org
Subject: Re: Is there Any api that let DataStream join DataSet ?
References: <BAY168-W5154E4012A0BFAE0F44B9BD6AB0@phx.gbl>
	<CAKADb_N2i4h0LnuH8SJKXLOkiYcOA2Aoxsm9iTYTO7KxKOk2-A@mail.gmail.com>
 <CANC1h_t22zt+4DnJXmVWJ_Kr_hdozYzp122qn61AYGAGW-Hvig@mail.gmail.com>
In-Reply-To: 
 <CANC1h_t22zt+4DnJXmVWJ_Kr_hdozYzp122qn61AYGAGW-Hvig@mail.gmail.com>
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature";
 boundary="rkwDetFL5wdXcbpcQWs43V8VROVclAx7D"

--rkwDetFL5wdXcbpcQWs43V8VROVclAx7D
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

I am wondering what the semantics of a DataStream created from a file
is. It should be a regular (but finite) stream. From my understanding, a
Window-Join is defined with some ts-constraint. So the static file part
will also have this restriction in the join, right? However, a
file-stream-join should join *all* data from the file with each element
in the stream... It seems to me, that a file-DataStream would not yield
this result. Am I wrong?


On 06/29/2015 11:00 AM, Stephan Ewen wrote:
> If you only want to "join" a finite data set (like a file) to a stream,=
 you
> can do that. you can create a DataStream from a (distributed) file.
>=20
> If you want specific batch-api operations, this is still on the roadmap=
,
> not in yet, as Marton said.
>=20
> On Sun, Jun 28, 2015 at 10:45 AM, M=C3=A1rton Balassi <balassi.marton@g=
mail.com>
> wrote:
>=20
>> Hi,
>>
>> Flink currently does not have explicit Api support for that, but is
>> definitely possible to do. In fact Gyula (cc-d) mocked up a prototype =
for a
>> similar problem some time ago.
>>
>> The idea needs some refinement to properly support all the viable use =
cases
>> though and the streaming Api currently has some more pressing challeng=
es
>> than this integration. :)
>>
>> It's on our roadmap, but is not an immediate task. Could you tell us m=
ore
>> about your use case?
>>
>> Best,
>> Marton
>> On Jun 28, 2015 8:29 AM, "=E9=A9=AC=E5=9B=BD=E7=BB=B4" <maguowei@outlo=
ok.com> wrote:
>>
>>> Hi,everyone:
>>> Is there Any api that let the DataStream join a DataSet ? I have read=
 all
>>> the document But I can't find .
>>> If Flink now does not have the api, will Flink support it in the futu=
re ?
>>>  thanks a lot!
>>>
>>
>=20


--rkwDetFL5wdXcbpcQWs43V8VROVclAx7D
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQIcBAEBCAAGBQJVkQ/LAAoJEBXkotPFErDWlU4P/2fCVXcC6iyhcmZZe8PIZ2X1
DTdc3T+liSDJWXylUoxq8iXg+T7k10cY4ExTekACL2CDiI2xVow55tnIro9Pntbp
/CACaQXLHJKE8IVg75Og55LGVUy+ce3aLgwMk4tdMapXSdN117PVJQN7B/5M0rVr
f5ChU/q8o8bqfP5sv7kwoAgjBVmcnzUDeLsEl6Dmp2nqiHtPqbVIy/7wCVjOyYh4
ehlq6cVQo22QVa+hLEx/O+sasS2hWUqBWMMyrqx1ScWbRjD4S0tOyejr8ArVJmDG
OqX4vaxghf3zgVChoxezqWO3TUkTudDxziSdknnquM5bhYLIjfg3Hfg4uaX+8B98
eTmUf+8AAvFBsTzvYkSfKD8QwdN4Mq7kXs/ibZjU+KIIuHa57Zwlf4MkisFqHn8Y
VC8MLcL2jY70fqTVuDs430AI9yYp6+djz0gD72UnXOuwhhZnsEUEl5PKoiVV9ERh
/6hnxuzqsbHT7qYRawU1sErq2cRfc0oNq2voAzZJQZFVolzrCSdUFIrMh9tu1nUq
MS+uQL1KF4ERtsrnHISKW5m3rAv+X0AydA4T+JaTldQHPyVhYca/cRnAd1Ov4pQR
IvchxInXxi1v7IzD6n9k/5RVO/lb1TeGxzXrDLTrejyfuSvwOSU3FMPgj5yZOHta
3UWBknA+m/lmPoZF8SdY
=ygbn
-----END PGP SIGNATURE-----

--rkwDetFL5wdXcbpcQWs43V8VROVclAx7D--