hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dhruba Borthakur <dhr...@gmail.com>
Subject Re: [VOTE] port HDFS-127 (DFSClient block read failures cause open DFSInputStream to become unusable) to hadoop 0.20/0.21
Date Mon, 19 Oct 2009 22:59:58 GMT
+1.

On Mon, Oct 19, 2009 at 3:55 PM, Chris Douglas <chris.douglas@gmail.com>wrote:

> +1 This fix has been in limbo for a long time; thanks for finishing
> it, Nicholas. -C
>
> On Mon, Oct 19, 2009 at 2:34 PM, Tsz Wo (Nicholas), Sze
> <s29752-hadoopdev@yahoo.com> wrote:
> > DFSClient has a retry mechanism on block acquiring for read.  If the
> number of retries attends to a certain limit (defined by
> dfs.client.max.block.acquire.failures), DFSClient will throw a
> BlockMissingException back to the user application.  In the current
> implementation, DFSClient counts the failures across multiple block
> acquiring operations but the block acquiring operations are supposed to be
> independent.  HDFS-127 fixes this problem by counting the failures within a
> single operation.
> >
> > I propose to commit HDFS-127 to 0.20 and above since this fix is safe and
> very useful.
> >
> > Nicholas Sze
> >
> >
>



-- 
Connect to me at http://www.facebook.com/dhruba

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message