hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alo alt <wget.n...@googlemail.com>
Subject Re: Re:Re: hiveserver usage
Date Mon, 12 Dec 2011 08:09:05 GMT
Hi,

see I right you set java with -xmx=15000M?  And you set minimum heap size
(xms) = 15000M?
Here you give java no chance to use less than 15GB memory, because min says
15000M, and max too. I wondering why any java-process have to need 15G of
memory. Could be in large tomcat od jboss environments. But for hive I'm
quite not sure..

- Alex


2011/12/12 王锋 <wfeng1982@163.com>

>
> I want to know why the hiveserver use so large memory,and where the memory
> has been used ?
>
> 在 2011-12-12 10:02:44,"王锋" <wfeng1982@163.com> 写道:
>
>
> The namenode summary:
>
>
>
> the mr summary
>
>
> and hiveserver:
>
>
> hiveserver jvm args:
> export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=1 -Xms15000m
> -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+UseParallelGC
> -XX:ParallelGCThreads=20 -XX:+UseParall
> elOldGC -XX:-UseGCOverheadLimit -verbose:gc -XX:+PrintGCDetails
> -XX:+PrintGCTimeStamps"
>
> now we  using 3 hiveservers in the same machine.
>
>
> 在 2011-12-12 09:54:29,"Aaron Sun" <aaron.sun82@gmail.com> 写道:
>
> how's the data look like? and what's the size of the cluster?
>
> 2011/12/11 王锋 <wfeng1982@163.com>
>
>> Hi,
>>
>>     I'm one of engieer of sina.com.  We have used hive ,hiveserver
>> several months. We have our own tasks schedule system .The system can
>> schedule tasks running with hiveserver by jdbc.
>>
>>     But The hiveserver use mem very large, usally  large than 10g.   we
>> have 5min tasks which will be  running every 5 minutes.,and have hourly
>> tasks .total num of tasks  is 40. And we start 3 hiveserver in one linux
>> server,and be cycle connected .
>>
>>     so why Memory of  hiveserver  using so large and how we do or some
>> suggestion from you ?
>>
>> Thanks and Best Regards!
>>
>> Royce Wang
>>
>>
>>
>>
>>
>
>
>
>
>


-- 
Alexander Lorenz
http://mapredit.blogspot.com

*P **Think of the environment: please don't print this email unless you
really need to.*

Mime
View raw message