accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jianshi Huang <jianshi.hu...@gmail.com>
Subject Re: MutationsRejectedException and TApplicationException
Date Wed, 18 Jun 2014 17:25:43 GMT
Just want to correct that -Xmx32g won't enable compressed pointers. Set it
to -Xmx31g

Jianshi


On Thu, Jun 19, 2014 at 1:20 AM, Jianshi Huang <jianshi.huang@gmail.com>
wrote:

> I see. The native map was enabled already.
>
> I think I understand better now how Accumulo uses my memory. So I
> increased data cache to 4G and index cache to 16G as memory is not a
> problem (the machines all have 128G per node...and runs other hadoop tasks)
>
> Jianshi
>
>
>
> On Thu, Jun 19, 2014 at 1:13 AM, Eric Newton <eric.newton@gmail.com>
> wrote:
>
>> Yes... keeping MaxNewSize small reduces the time to collect the New
>> Generation, which is a stop-the-world gc.
>>
>> 32G max jvm runtime is probably excessive if you are using the native map
>> (since it doesn't take up JVM memory).
>>
>> Check the gc lines in your tserver debug log to see how much of the JVM
>> memory you are actually using.
>>
>> -Eric
>>
>>
>> On Wed, Jun 18, 2014 at 1:04 PM, Jianshi Huang <jianshi.huang@gmail.com>
>> wrote:
>>
>>> I see. thank you Josh and Eric.
>>>
>>> BTW, here's my current JVM memory settings: -Xmx32g -Xms4g
>>> -XX:NewSize=2G -XX:MaxNewSize=2G (Xmx < 32g for enabling CompressedOops by
>>> default)
>>>
>>> Is 2G good enough for MaxNewSize?
>>>
>>>
>>> Cheers,
>>> Jianshi
>>>
>>>
>>> On Thu, Jun 19, 2014 at 12:54 AM, Eric Newton <eric.newton@gmail.com>
>>> wrote:
>>>
>>>>
>>>> On Wed, Jun 18, 2014 at 12:51 PM, Jianshi Huang <
>>>> jianshi.huang@gmail.com> wrote:
>>>>
>>>>> Oh, this memory size:
>>>>>
>>>>> tserver.memory.maps.max
>>>>> 1G -> 20G (looks like this is an overkill, is it?)
>>>>>
>>>>
>>>> Probably.  If you have a spare 20G, though... :-)
>>>>
>>>>
>>>>>
>>>>> tserver.cache.data.size
>>>>> 128M? -> 1024M
>>>>>
>>>>> tserver.cache.index.size
>>>>> 128M? -> 1024M
>>>>>
>>>>
>>>> These will help with query, not ingest.
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Jianshi Huang
>>>
>>> LinkedIn: jianshi
>>> Twitter: @jshuang
>>> Github & Blog: http://huangjs.github.com/
>>>
>>
>>
>
>
> --
> Jianshi Huang
>
> LinkedIn: jianshi
> Twitter: @jshuang
> Github & Blog: http://huangjs.github.com/
>



-- 
Jianshi Huang

LinkedIn: jianshi
Twitter: @jshuang
Github & Blog: http://huangjs.github.com/

Mime
View raw message