flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ken Krugler <kkrugler_li...@transpac.com>
Subject EMR vCores and slot allocation
Date Thu, 28 Apr 2016 23:58:25 GMT
Based on what Flink reports in the JobManager GUI, it looks like it thinks that the EC2 instances
I’m using for my EMR jobs only have 4 physical cores.

Which would make sense, as Amazon describes these servers as having 8 vCores.

From https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html <https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html>,
the recommended configuration would then be 4 slots/TaskManager, yes?

Thanks,

— Ken

--------------------------
Ken Krugler
+1 530-210-6378
http://www.scaleunlimited.com
custom big data solutions & training
Hadoop, Cascading, Cassandra & Solr




Mime
View raw message