hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11887) Memory retention in branch-1; millions of instances of LiteralByteString for column qualifier and value
Date Wed, 03 Sep 2014 21:13:53 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120466#comment-14120466
] 

stack commented on HBASE-11887:
-------------------------------

OK. Let me commit. Its been running this last few hours w/o a full GC. I have it set so a
full GC kills the RS using below configs:

export SERVER_GC_OPTS="-verbose:gc -XX:PrintFLSStatistics=1 -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-XX:+HeapDumpBeforeFullGC -XX:HeapDumpPath=/data/1/ -XX:+CMSDumpAtPromotionFailure -XX:+HeapDumpAfterFullGC
-XX:+PrintTenuringDistribution -XX:+PrintGCApplicationConcurrentTime -XX:+PrintGCApplicationStoppedTime"

It used to run out of road -- full GC -- after 5 minutes or so.

> Memory retention in branch-1; millions of instances of LiteralByteString for column qualifier
and value
> -------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-11887
>                 URL: https://issues.apache.org/jira/browse/HBASE-11887
>             Project: HBase
>          Issue Type: Bug
>          Components: Protobufs
>    Affects Versions: 0.99.0
>            Reporter: stack
>            Assignee: stack
>            Priority: Critical
>             Fix For: 0.99.0, 2.0.0
>
>         Attachments: 11887.txt, Screen Shot 2014-09-03 at 10.18.58 AM.png
>
>
> Trying to test branch-1, I run out of mem pretty fast.  Looking at dumps, I see too many
instances of LiteralByteString.  Seem to be 'qualifiers' and 'values' out of pb QualifierValue...
and on up to the multi call into the server. Am having trouble finding how the retention is
being done... Filing issue in meantime while work on it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message