hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <apurt...@yahoo.com>
Subject Re: ZK rethink?
Date Tue, 07 Apr 2009 21:23:15 GMT

Thanks for the input!

Ok, I'll try these things in sequence:

  - Run incremental garbage collector (-XX:+UseConcMarkSweepGC

  - Increase timeout

  - Increase quorum

Thanks again,

  - Andy

> From: Joey Echeverria <joey42@gmail.com>
> Subject: Re: ZK rethink?
> To: hbase-dev@hadoop.apache.org
> Date: Tuesday, April 7, 2009, 1:43 PM
> Long time lurker, first time poster.
> We've used zookeeper in a write-heavy project we've
> been working on and experienced issues similar to what
> you described. After several days of debugging, we
> discovered that our issue was garbage collection. There
> was no way to guarantee we wouldn't have long pauses
> especially since our environment was the worst case for
> garbage collection, millions of tiny, short lived
> objects. I suspect HBase sees similar work loads
> frequently, if it's not constantly. With anything
> shorter than a 30 second session time out, we got
> session expiration events extremely frequently. We
> needed to use 60 seconds for any real confidence that
> an ephemeral node disappearing meant something was
> unavailable.


View raw message