flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stefano Baghino <stefano.bagh...@radicalbit.io>
Subject Re: how to convert datastream to collection
Date Wed, 04 May 2016 11:10:16 GMT
I believe you may suffer from some undefined behaviour by using different
versions for Flink and contrib libraries.
Please note that in your dependency declaration there's a
typo: flink-streaming-contrib_${flink.version} should
be flink-streaming-contrib_${scala.version}, with ${scala.version} being
the one you use, either 2.10 or 2.11.

On Wed, May 4, 2016 at 12:43 PM, subash basnet <yasubash@gmail.com> wrote:

> Hello Stefano,
>
> When I did as you said, it shows: *Missing artifact
> org.apache.flink:flink-streaming-contrib_1.0.0:jar:1.0.0* error.
> My pom is:
> <properties>
> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
> <flink.version>1.0.0</flink.version>
> </properties>
> <dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>*flink-streaming-contrib_${flink.version}*</artifactId>
> <version>*${flink.version}*</version>
> </dependency>
>
> So I instead used the below for contrib dependency as given in maven
> repository:
> <dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>flink-streaming-contrib</artifactId>
> <version>0.10.2</version>
> </dependency>
>
>
> Best Regards,
> Subash Basnet
>
> On Wed, May 4, 2016 at 12:12 PM, Stefano Baghino <
> stefano.baghino@radicalbit.io> wrote:
>
>> I think you have to explicitly import contrib packages as a dependency in
>> Maven/SBT.
>>
>> In particular, in your case, it should be something like:
>>
>> <dependency>
>> <groupId>org.apache.flink</groupId>
>> <artifactId>flink-streaming-contrib_${scala.version}</artifactId>
>> <version>${project.version}</version>
>> </dependency>
>>
>> for Maven.
>>
>> On Wed, May 4, 2016 at 12:00 PM, subash basnet <yasubash@gmail.com>
>> wrote:
>>
>>> Hello there,
>>>
>>> Thank you! But I couldn't find DataStreamUtils. Where is it located?
>>> I am using <flink.version>*1.0.0*</flink.version>,
>>> The given,
>>> org.apache.flink.*contrib*.streaming.DataStreamUtils doesn't work as
>>> there is no *contrib *package within org.apache.flink.
>>>
>>>
>>> Best Regards,
>>> Subash Basnet
>>>
>>> On Tue, May 3, 2016 at 4:35 PM, Suneel Marthi <smarthi@apache.org>
>>> wrote:
>>>
>>>> [image: Boxbe] <https://www.boxbe.com/overview> This message is
>>>> eligible for Automatic Cleanup! (smarthi@apache.org) Add cleanup rule
>>>> <https://www.boxbe.com/popup?url=https%3A%2F%2Fwww.boxbe.com%2Fcleanup%3Ftoken%3DreP2r48pKUa39v%252BHyshfrCrg6NOF1l7x0fQbG5CgONuGeaoFt%252B0MEkfhlWsK284TedwqHXrgsxKwx9SwMsfCTE%252Bwano8eHrWF4JHw%252Bk2c63GgLhuq74L7vMjaml3H9vLpCADALgCPlU%253D%26key%3DtqjcnI5NGF5kdpN%252FHUUJJ3wci2Mj9yq8k2inACOoMSE%253D&tc_serial=25281140543&tc_rand=1148713187&utm_source=stf&utm_medium=email&utm_campaign=ANNO_CLEANUP_ADD&utm_content=001>
>>>> | More info
>>>> <http://blog.boxbe.com/general/boxbe-automatic-cleanup?tc_serial=25281140543&tc_rand=1148713187&utm_source=stf&utm_medium=email&utm_campaign=ANNO_CLEANUP_ADD&utm_content=001>
>>>>
>>>> DataStream<Tuple2<String,Point>> *newCentroids = new
>>>> DataStream<>.....()*
>>>>
>>>> *Iterator<Tuple2<String, Point>> iter =
>>>> DataStreamUtils.collect(newCentroids);*
>>>>
>>>> *List<Tuple2<>> list = Lists.newArrayList(iter);*
>>>>
>>>> On Tue, May 3, 2016 at 10:26 AM, subash basnet <yasubash@gmail.com>
>>>> wrote:
>>>>
>>>>> Hello all,
>>>>>
>>>>> Suppose I have the datastream as:
>>>>> DataStream<Tuple2<String,Point>> *newCentroids*;
>>>>>
>>>>> How to get collection of *newCentroids * to be able to loop as below:
>>>>>  private Collection<Tuple2<String,Point>> *centroids*;
>>>>>  for (Centroid cent : *centroids*) {
>>>>>   }
>>>>>
>>>>>
>>>>>
>>>>> Best Regards,
>>>>> Subash Basnet
>>>>>
>>>>
>>>>
>>>>
>>>
>>
>>
>> --
>> BR,
>> Stefano Baghino
>>
>> Software Engineer @ Radicalbit
>>
>
>


-- 
BR,
Stefano Baghino

Software Engineer @ Radicalbit

Mime
View raw message