flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sendoh <unicorn.bana...@gmail.com>
Subject setParallelism() for addSource() in streaming
Date Fri, 27 Jan 2017 10:09:34 GMT
Hi Flink users,

I'd like to setup different parallelisms for different source.

I found we cannot 
DataStream<String> bigStream = env.addSource(
                new FooSource(properties, bigTopic)
        ).setParallelism(5)..rebalance();

DataStream<String> smallStream = env.addSource(
                new FooSource(properties, smallTopic)
        ).setParallelism(1)..rebalance();
   
        env.setParallelism(3);
//do .map(), window(), ...

But I can set the following:

DataStream<String> bigStream = env.setParallelism(5).addSource(
                new FooSource(properties, bigTopic)
        ).rebalance();

DataStream<String> smallStream = env.setParallelism(1).addSource(
                new FooSource(properties, smallTopic)
        ).rebalance();

        env.setParallelism(3);
//do .map(), window(), ...

Would it have the same effect?

Best,

Sendoh



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/setParallelism-for-addSource-in-streaming-tp11343.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message