hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Mawata <chris.maw...@gmail.com>
Subject Re: Copy hdfs block from one data node to another
Date Wed, 09 Jul 2014 21:19:59 GMT
Haven't looked at the source but the thing you are trying to do sounds
similar to what happens when you are decommissioning a datanode. I would
hunt for that code.
Cheers
Chris
On Jul 9, 2014 3:41 PM, "Yehia Elshater" <y.z.elshater@gmail.com> wrote:

> Hi Chris,
>
> Actually I need this functionality for my research, basically for fault
> tolerance. I can calculate some failure probability for some data nodes
> after certain unit of time. So I need to copy all the blocks reside on
> these nodes to another nodes.
>
> Thanks
> Yehia
>
>
> On 7 July 2014 20:45, Chris Mawata <chris.mawata@gmail.com> wrote:
>
>> Can you outline why one would want to do that? The blocks are disposable
>> so it is strange to manipulate them directly.
>>  On Jul 7, 2014 8:16 PM, "Yehia Elshater" <y.z.elshater@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> How can copy a certain hdfs block (given the file name, start and end
>>> bytes) from one node to another node ?
>>>
>>> Thanks
>>> Yehia
>>>
>>
>

Mime
View raw message