hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <apurt...@apache.org>
Subject Re: Stargate perf and troubleshooting tips
Date Thu, 07 Aug 2014 20:45:43 GMT
On Wed, Aug 6, 2014 at 11:20 PM, SiMaYunRui <mylpis@hotmail.com> wrote:

> Further investigation showsthat if I repeatedly fetch data very quick, the
> latter scanner creations are very fast (< 100ms), but if there is >1minute
> interval between two data fetching, the latter is slow.
> ​
> I am certain that it’s not caused by TCP/SSL handshake (fiddler proves
> that). So I believe there must be a resource reuse somewhere no matter in
> Rest service code or hbase server code.​


​Stargate functions as a client to the HBase cluster. Both the RPC client -
here, Stargate - and the RPC server - here, the RegionServer(s) - have
configurable intervals for keeping idle connections around. Either the
client or server will eventually drop the connection. Who does it depends
on the configured timeouts. You can increase the defaults but it would be
better not to hold scanner resources open.

If you are using version 0.98, we have a new stateless scanning option that
avoids the setup costs of old style scanners. See
https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/rest/package-summary.html#operation_stateless_scanner



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message