hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kihwal Lee <kih...@yahoo-inc.com>
Subject Re: HDFS-1599 status? (HDFS tickets to improve HBase)
Date Fri, 03 Jun 2011 14:07:11 GMT
The trunk has moved on so the patch won't apply.  There has been significant changes in HDFS
lately, so it will require more than simple rebase/merge.  If the original assignee is busy,
I am willing to help.

The analysis is pointing out that local socket communication is actually not the problem.
The initial assumption of local socket being slow should be ignored and the design should
be revisited.

I agree that improving local pread performance is critical.  Based on my experiments, HDFS-941
helps a lot and the communication channel became no longer the bottleneck.


On 6/2/11 4:00 PM, "Doug Meil" <doug.meil@explorysmedical.com> wrote:

Hi folks, I was wondering if there was any movement on any of these HDFS tickets for HBase.
 The umbrella ticket is HDFS-1599, but the last comment from stack back in Feb highlighted
interest in several tickets:

1)      HDFS-918 (use single selector)

a.       Last comment Jan 2011

2)      HDFS-941 (reuse of connection)

a.       Patch available as of April 2011

b.      But ticket still unresolved.

3)      HDFS-347 (local reads)

a.       Discussion seemed to end in March 2011 with a huge comment saying that there was
no performance benefit.

b.      I'm working my way through this comment/report, but intuitively it seems like it would
be a good idea since as the other comments in the ticket stated the RS reads locally just
about every time.

Doug Meil
Chief Software Architect, Explorys

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message