hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Praveen Sripati <praveensrip...@gmail.com>
Subject Partitioning in Hama
Date Thu, 19 Apr 2012 01:01:03 GMT
1. Lets say the input is partitioned into part0, part1, part2, part3 and
part4. How is it ensured that bsp0 processes part0, bsp1 processes part1
and so on and there is no mix? We don't want bsp0 to process part1.

private void send(BSPPeerProtocol peer, BSPMessage msg) throws IOException {
  int mod = ((Integer) msg.getTag()) % peer.getAllPeerNames().length;
  peer.send(peer.getAllPeerNames()[mod], msg);

2) If the partition file size is more than the HDFS block size and 1+ bsp
task processes a single partition, how is this scenario handled?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message