hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raghu Angadi <rang...@yahoo-inc.com>
Subject Re: Many Checksum Errors
Date Wed, 16 May 2007 19:08:36 GMT
Hairong Kuang wrote:
> What Doug suggested makes sense. We should make the initial buffer size to
> be bytesPerChecksum and the user defined buffer size to be the size of the
> second buffer. This will also solve most of the problems that I described in
> HADOOP-1124.

But this will not fix the same problem with block-level checksums. 
Pretty soon, HDFS will not use ChecksumFileSystem at all. Ideally we 
should let the implementations decide how to buffer.

> Hairong

View raw message