zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: setting zookeeper heap size
Date Fri, 11 Nov 2011 04:59:32 GMT
The behavior without xmx is actually pretty reasonable.  Note that the
default of half is only up to a few hundred MB of memory (not GB).  Even
when lots of memory is allocated, the jvm avoids expanding the actual use
beyond reasonable need.

On Thu, Nov 10, 2011 at 8:35 PM, Camille Fournier <camille@apache.org>wrote:

> Btw I'm pretty sure res is used heap and virt is just mapped but yet to be
> filled. Use jstat -gc to see actual usage for the various collectors.
>
> Also, if it's true that the jvm defaults to a xmx of half the ram (wtf bad
> decision) we had better ship zk start scripts with more reasonable xmx
> configured.
> Although I've used u18 and u23 extensively on 64bit servers and never seen
> it default to half the physical memory, or 32gig.
>
> C
>
> From my phone
> On Nov 10, 2011 6:50 PM, "Ed Sexton" <sextonhadoop@gmail.com> wrote:
>
> > Hi Henry,
> >
> > I checked the process listing via ps and top, and saw VIRT=6477m  and
> > RES=83m.
> >
> > How would one check if it is the jvm heap vs mapped space?
> >
> > Thanks as always Henry.
> > Ed
> >
> > On Thu, Nov 10, 2011 at 2:04 PM, Henry Robinson <henry@cloudera.com>
> > wrote:
> >
> > > Ed - how are you making the observation that the heap size is 6477m? Is
> > it
> > > from a profiler, or from top or similar? The amount of virtual memory
> > > mapped for Java processes can often be very large, especially on recent
> > > RHEL systems with the new arena allocator in glibc. Worth checking
> > whether
> > > it's the JVM heap or the amount of mapped space.
> > >
> > > cheers,
> > > Henry
> > >
> > > On 10 November 2011 13:47, Ed Sexton <sextonhadoop@gmail.com> wrote:
> > >
> > > > Hello Group-
> > > >
> > > > I am running CDH zookeeper version 3.3.3+12.12 and noticed that
> > zookeeper
> > > > is running with a heapsize of 6477m.
> > > >
> > > > I start zookeeper standalone, via
> /etc/init.d/hadoop-zookeeper-server.
> >  I
> > > > do not see reference to any ZOOKEEPER_HEAPIZE in the startup or
> > zoo.cfg,
> > > > nor do I see any special JVMFLAGS in export/usr/bin/zookeeper-server,
> > > which
> > > > is what is called by the startup script, it just has this definition:
> > > >
> > > > JVMFLAGS=-Dzookeeper.log.threshold=INFO
> > > >
> > > > Can someone guide me to where the 6GB heapsize is being referenced?
> >  This
> > > > seems a bit large of a heap.
> > > >
> > > > Thanks for your guidance.
> > > >
> > > > Sincerely,
> > > > Ed
> > > >
> > >
> > >
> > >
> > > --
> > > Henry Robinson
> > > Software Engineer
> > > Cloudera
> > > 415-994-6679
> > >
> >
> >
> >
> > --
> > Sincerely,
> > Ed Sexton
> > e: sextonhadoop@gmail.com
> > gv: (408) 475-2358
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message