hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From stack <st...@duboce.net>
Subject Re: short-circuiting HDFS reads
Date Thu, 08 Jan 2009 22:23:31 GMT
On Thu, Jan 8, 2009 at 10:39 AM, Doug Cutting <cutting@apache.org> wrote:

> So this sort of optimization may only have a significant impact for jobs
> whose maps do not produce much output.


Don't forget the lowly non-MR users of HDFS.  The short-circuit looks
promising improving HDFS random access times.
St.Ack

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message