hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vaibhav Gumashta <vgumas...@hortonworks.com>
Subject Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Date Wed, 21 May 2014 21:31:53 GMT
Meng, are you running a remote metastore or an embedded one (which would be
true if you added this config while starting HS2: -hiveconf
hive.metastore.uris=" ")?

Thanks,
--Vaibhav


On Wed, May 21, 2014 at 2:28 PM, Vaibhav Gumashta <vgumashta@hortonworks.com
> wrote:

> Thanks a lot for the dump Meng!
>
>
> On Wed, May 21, 2014 at 1:41 AM, Meng QingPing <mqingping@gmail.com>wrote:
>
>> I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin
>>
>> Thanks.
>>
>>
>> 2014-05-21 15:41 GMT+08:00 Meng QingPing <mqingping@gmail.com>:
>>
>> > There are 18908 PM-s. I post it on
>> > http://jack-meng.qiniudn.com/hive-heap2.png
>> >
>> > Thanks.
>> >
>> >
>> > 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <sergey@hortonworks.com>:
>> >
>> > What is the count of PM-s that you are seeing when it crashes? From that
>> >> screenshot I don't see what the problem is or I'm not reading it right.
>> >>
>> >>
>> >> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mqingping@gmail.com>
>> >> wrote:
>> >>
>> >> > Thanks.
>> >> >
>> >> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <sergey@hortonworks.com
>> >:
>> >> >
>> >> > > I don't think the dev list supports attachment. Can you post to
>> some
>> >> > image
>> >> > > sharing service?
>> >> > >
>> >> > >
>> >> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mqingping@gmail.com
>> >
>> >> > wrote:
>> >> > >
>> >> > > >
>> >> > > > Weird, the picture attached in sent mail.
>> >> > > >
>> >> > > > Anyway send again.
>> >> > > >
>> >> > > >
>> >> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <chandu.cr@gmail.com>:
>> >> > > >
>> >> > > > seems you have missed attachment.
>> >> > > >> -Chandra
>> >> > > >>
>> >> > > >>
>> >> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <
>> mqingping@gmail.com
>> >> >
>> >> > > >> wrote:
>> >> > > >>
>> >> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2
OOM
>> >> and
>> >> > the
>> >> > > >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
>> >> > > >> > JDOPersistenceManagerFactory" as attached. It seems
not
>> release
>> >> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive
version is
>> >> 0.13.
>> >> > > >> >
>> >> > > >> > Thanks,
>> >> > > >> > Jack
>> >> > > >> >
>> >> > > >>
>> >> > > >>
>> >> > > >>
>> >> > > >> --
>> >> > > >> Thanks,
>> >> > > >> -Chandra.
>> >> > > >>
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > --
>> >> > > > Thanks,
>> >> > > > Qingping
>> >> > > >
>> >> > >
>> >> > > --
>> >> > > CONFIDENTIALITY NOTICE
>> >> > > NOTICE: This message is intended for the use of the individual
or
>> >> entity
>> >> > to
>> >> > > which it is addressed and may contain information that is
>> >> confidential,
>> >> > > privileged and exempt from disclosure under applicable law. If
the
>> >> reader
>> >> > > of this message is not the intended recipient, you are hereby
>> notified
>> >> > that
>> >> > > any printing, copying, dissemination, distribution, disclosure
or
>> >> > > forwarding of this communication is strictly prohibited. If you
>> have
>> >> > > received this communication in error, please contact the sender
>> >> > immediately
>> >> > > and delete it from your system. Thank You.
>> >> > >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Thanks,
>> >> > Qingping
>> >> >
>> >>
>> >> --
>> >> CONFIDENTIALITY NOTICE
>> >> NOTICE: This message is intended for the use of the individual or
>> entity
>> >> to
>> >> which it is addressed and may contain information that is confidential,
>> >> privileged and exempt from disclosure under applicable law. If the
>> reader
>> >> of this message is not the intended recipient, you are hereby notified
>> >> that
>> >> any printing, copying, dissemination, distribution, disclosure or
>> >> forwarding of this communication is strictly prohibited. If you have
>> >> received this communication in error, please contact the sender
>> >> immediately
>> >> and delete it from your system. Thank You.
>> >>
>> >
>> >
>> >
>> > --
>> > Thanks,
>> > Qingping
>> >
>>
>>
>>
>> --
>> Thanks,
>> Qingping
>>
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message