hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: Short-circuit reads
Date Sun, 27 Jan 2013 22:45:01 GMT


On Sun, Jan 27, 2013 at 2:29 PM, David Koch <ogdude@googlemail.com> wrote:
> Hello,
> I read about "short circuit reads" in the HBase documentation's performance
> section[1] and was wondering what people's experiences were using this in a
> production setting.
> Also,
> 1. Since only one dedicated user can take advantage of the feature do you
> launch all jobs as this user?

That's the big limitation right now. Running everything as the same
user can make managing jobs difficult, also that user would need to be
the same as HBase's.

FWIW, HDFS-347 should fix those limitions but it's not committed yet
(getting close tho).

> 2. Can dfs.client.read.shortcircuit be set to false for jobs wich are not
> launched by the short-circuit user in order to avoid exceptions? In other
> words - can this setting be overriden by the client configuration's
> hbase-site.xml?

Yes, but those exceptions are really harmless.

> 3. In the same context, it is suggested to enable HBase internal
> checksums[2]. Is this a feature which can be enabled in HBase 0.92.1 which
> is part of the Cloudera 4.1.x release?

Yes on the first question, no on the second one (what Ted said)

> Thank you,
> /David
> [1] http://hbase.apache.org/book/perf.hdfs.html#ftn.d2145e7370
> [2] https://issues.apache.org/jira/browse/HBASE-5074

View raw message