hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suresh Srinivas <sures...@yahoo-inc.com>
Subject Re: [VOTE] port HDFS-127 (DFSClient block read failures cause open DFSInputStream to become unusable) to hadoop 0.20/0.21
Date Mon, 19 Oct 2009 22:51:29 GMT

On 10/19/09 2:34 PM, "Tsz Wo (Nicholas), Sze" <s29752-hadoopdev@yahoo.com> wrote:

DFSClient has a retry mechanism on block acquiring for read.  If the number of retries attends
to a certain limit (defined by dfs.client.max.block.acquire.failures), DFSClient will throw
a BlockMissingException back to the user application.  In the current implementation, DFSClient
counts the failures across multiple block acquiring operations but the block acquiring operations
are supposed to be independent.  HDFS-127 fixes this problem by counting the failures within
a single operation.

I propose to commit HDFS-127 to 0.20 and above since this fix is safe and very useful.

Nicholas Sze

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message