hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raghu Angadi <rang...@yahoo-inc.com>
Subject Re: short-circuiting HDFS reads
Date Wed, 07 Jan 2009 18:18:30 GMT


Jun Rao wrote:
> Hi,
> Today, HDFS always reads through a socket even when the data is local to
> the client. This adds a lot of overhead, especially for warm reads. It
> should be possible for a dfs client to test if a block to be read is local
> and if so, bypass socket and read through local FS api directly. This
> should improve random access performance significantly (e.g., for HBase).
> Has this been considered in HDFS? Thanks,
> Jun

View raw message