giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravikant Dindokar <>
Subject Worker to task id mapping in giraph
Date Mon, 27 Nov 2017 05:54:10 GMT

I am trying to change the mapping of partitions to workers in

createInitialPartitionOwners(Collection<WorkerInfo> availableWorkerInfos,
int maxWorkers) defined

The first argument to this method is the list of available workers and each
worker has a task id associated with it.

When I am specifying the number of workers as 40, the task id are 1 to 40.

I have removed one node from the yarn-cluster by following this answer

After this change, the task ids assigned to the workers are no longer
consecutive (e.g. for 40 workers the range of task id is 1- 43). Some
task-ids are excluded.

Is there any way to get these task ids strictly consecutive?


View raw message