hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "gaojinchao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4028) Hmaster crashes caused by splitting log.
Date Sat, 25 Jun 2011 09:28:47 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054847#comment-13054847
] 

gaojinchao commented on HBASE-4028:
-----------------------------------

The verified result:
hbase-root-master-157-5-111-22.log:2011-06-25 17:18:53,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:18:56,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:18:59,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:02,768 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:05,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:08,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:11,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:14,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:17,769 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:20,770 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO threads...
hbase-root-master-157-5-111-22.log:2011-06-25 17:19:23,770 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
Used 134314752 bytes of buffered edits, waiting for IO thre

> Hmaster crashes caused by splitting log.
> ----------------------------------------
>
>                 Key: HBASE-4028
>                 URL: https://issues.apache.org/jira/browse/HBASE-4028
>             Project: HBase
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 0.90.3
>            Reporter: gaojinchao
>            Assignee: gaojinchao
>             Fix For: 0.90.4
>
>         Attachments: HBASE-4028-0.90V2, Screenshot-2.png, hbase-root-master-157-5-100-8.rar
>
>
> In my performance cluster(0.90.3), The Hmaster memory from 100 M up to 4G when one region
server crashed.
> I added some print in function doneWriting and found the values of totalBuffered is negative.
> 10:29:52,119 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: gjc:release
Used -565832
> hbase-root-master-157-5-111-21.log:2011-06-24 10:29:52,119 WARN org.apache.hadoop.hbase.regionserver.wal.HLogSplitter:
gjc:release Used -565832release size25168
> void doneWriting(RegionEntryBuffer buffer) {
>       synchronized (this) {
>     	LOG.warn("gjc1: relase currentlyWriting +biggestBufferKey " + buffer.encodedRegionName
);
>         boolean removed = currentlyWriting.remove(buffer.encodedRegionName);
>         assert removed;
>       }
>       long size = buffer.heapSize();
>       synchronized (dataAvailable) {
>         totalBuffered -= size;
>         LOG.warn("gjc:release Used " + totalBuffered );
>         // We may unblock writers
>         dataAvailable.notifyAll();
>       }
>       LOG.warn("gjc:release Used " + totalBuffered + "release size"+ size);
>     }

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message