Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Sat, 25 Jun 2011 09:28:47 +0000 (UTC)
From: "gaojinchao (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: 
 <1060061188.40187.1308994127419.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1536355274.35781.1308896087684.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (HBASE-4028) Hmaster crashes caused by splitting
 log.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054847#comment-13054847 ] 

gaojinchao commented on HBASE-4028:
-----------------------------------

The verified result:
hbase-root-master-157-5-111-22.log:2011-06-25 17:18:53,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:18:56,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:18:59,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:02,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:05,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:08,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:11,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:14,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:17,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:20,770 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:23,770 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Used 134314752 bytes of buffered edits, waiting for IO thre

> Hmaster crashes caused by splitting log.
> ----------------------------------------
>
>                 Key: HBASE-4028
>                 URL: https://issues.apache.org/jira/browse/HBASE-4028
>             Project: HBase
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 0.90.3
>            Reporter: gaojinchao
>            Assignee: gaojinchao
>             Fix For: 0.90.4
>
>         Attachments: HBASE-4028-0.90V2, Screenshot-2.png, hbase-root-master-157-5-100-8.rar
>
>
> In my performance cluster(0.90.3), The Hmaster memory from 100 M up to 4G when one region server crashed.
> I added some print in function doneWriting and found the values of totalBuffered is negative.
> 10:29:52,119 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: gjc:release Used -565832
> hbase-root-master-157-5-111-21.log:2011-06-24 10:29:52,119 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: gjc:release Used -565832release size25168
> void doneWriting(RegionEntryBuffer buffer) {
>       synchronized (this) {
>     	LOG.warn("gjc1: relase currentlyWriting +biggestBufferKey " + buffer.encodedRegionName );
>         boolean removed = currentlyWriting.remove(buffer.encodedRegionName);
>         assert removed;
>       }
>       long size = buffer.heapSize();
>       synchronized (dataAvailable) {
>         totalBuffered -= size;
>         LOG.warn("gjc:release Used " + totalBuffered );
>         // We may unblock writers
>         dataAvailable.notifyAll();
>       }
>       LOG.warn("gjc:release Used " + totalBuffered + "release size"+ size);
>     }

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira