hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Who will Responsible for Handling DFS Write Pipe line Failure
Date Tue, 08 Sep 2015 01:26:09 GMT
These 2-part blog posts from Yongjun should help you understand the HDFS
file write recovery process better:

On Mon, Sep 7, 2015 at 10:39 AM miriyala srinivas <srinivas2828@gmail.com>

> Hi All,
> I am just started Learning fundamentals of  HDFS  and its internal
> mechanism , concepts used here are very impressive and looks simple but
> makes me confusing and my question is *who will responsible for handling
> DFS write failure in pipe line (assume replication factor is 3 and 2nd DN
> failed in the pipeline)*? if any data node failed during the pipe line
> write then the entire pipe line will get stopped? or new data node added to
> the existing pipe line? how this entire mechanism works?I really appreciate
> if someone with good knowledge of HDFS can explains to me.
> Note:I read bunch of documents but none seems to be explained what i am
> looking for.
> thanks
> srinivas

View raw message