flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From AndreaKinn <kinn6...@hotmail.it>
Subject About nodes number on Flink
Date Thu, 22 Jun 2017 14:54:20 GMT
Hello,
I'm developing a Flink toy-application on my local machine before to deploy
the real one on a real cluster.
Now I have to determine how many nodes I need to set the cluster.

I already read these documents:
jobs and scheduling
<https://ci.apache.org/projects/flink/flink-docs-release-1.3/internals/job_scheduling.html>
 
programming model
<https://ci.apache.org/projects/flink/flink-docs-release-1.2/concepts/programming-model.html>
 
parallelism
<https://flink.apache.org/faq.html#what-is-the-parallelism-how-do-i-set-it>  

But I'm still a bit confused about how many nodes I have to consider to
execute my application.

For example if I have the following code (from the doc):
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n13927/Screen_Shot_2017-06-22_at_16.png>


- This means that operations "on same line" are executed on same node? (It
sounds a bit strange to me)

Some confirms:
- If the answer to previous question is yes and if I set parallelism to '1'
I can establish how many nodes I need counting how many operations I have to
perform ?
- If I set parallelism to 'N' but I have less than 'N' nodes available Flink
automatically scales the elaboration on available nodes?

My throughput and data load is not relevant I think, it is not heavy.





--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/About-nodes-number-on-Flink-tp13927.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message