hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lokendra Singh <lsingh....@gmail.com>
Subject Re: Mapping from JobSplit to Blocks on datanodes
Date Tue, 29 Nov 2011 14:53:10 GMT
Any pointers please ?
I could see from the source says that it is not trivial to do.
Was just wanted to confirm if there are some API calls I might have missed.

Regards
Lokendra


On Mon, Nov 28, 2011 at 2:17 AM, Lokendra Singh <lsingh.969@gmail.com>wrote:

> Hi,
>
> How can I find which Job Split does a Block on a datanode belong to? Or
> going the other way, if I can find how a Job Split is eventually stored on
> datanodes i.e. the list of Blocks.
> Any pointers are appreciated.
>
> PS: My eventual objective is 'moving data to computation' (for some
> experiments) and hence was taking ideas from Balancer class to move blocks.
>
> Regards
> Lokendra
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message