hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Liochon (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-8305) Too much logs in the some tests
Date Tue, 09 Apr 2013 13:20:19 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13626576#comment-13626576
] 

Nicolas Liochon edited comment on HBASE-8305 at 4/9/13 1:19 PM:
----------------------------------------------------------------

bq. Instead of removing the debug log from HConnectionManager, can't we just move it to trace
like you did for ZKUtil?
I wanted to be a little bit extreme on this one. It was writing multiple lines per milliseconds,
even in trace it's too much.

TestAdmin is now at 5 MB
In the not reasonable area, we still have org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort-output.txt
235.95 MB, but it's likely a bug actually, with endless logs of
{noformat}
2013-04-09 11:35:25,985 ERROR [RegionServer:1;asf001.sp2.ygridcore.net,57349,1365507205376.logSyncer]
wal.FSHLog$LogSyncer(1023): Error while syncing, requesting close of hlog
java.io.IOException: DFSOutputStream is closed
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync(DFSClient.java:3845)
        at org.apache.hadoop.fs.FSDataOutputStream.sync(FSDataOutputStream.java:97)
        at org.apache.hadoop.io.SequenceFile$Writer.syncFs(SequenceFile.java:999)
        at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.sync(SequenceFileLogWriter.java:248)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1131)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1069)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.sync(FSHLog.java:1239)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog$LogSyncer.run(FSHLog.java:1021)
        at java.lang.Thread.run(Thread.java:662)
{noformat}

v2 removes fixes some side stuff, that's what I will commit if no one objects

                
      was (Author: nkeywal):
    bq. Instead of removing the debug log from HConnectionManager, can't we just move it to
trace like you did for ZKUtil?
I wanted to be a little bit extreme on this one. It was writing multiple lines per milliseconds,
even in trace it's too much.

TestAdmin is now at 5 MB
In the not reasonable area, we still have org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort-output.txt
235.95 MB, but it's likely a bug actually, with endless logs of
{noformat}
2013-04-09 11:35:25,985 ERROR [RegionServer:1;asf001.sp2.ygridcore.net,57349,1365507205376.logSyncer]
wal.FSHLog$LogSyncer(1023): Error while syncing, requesting close of hlog
java.io.IOException: DFSOutputStream is closed
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync(DFSClient.java:3845)
        at org.apache.hadoop.fs.FSDataOutputStream.sync(FSDataOutputStream.java:97)
        at org.apache.hadoop.io.SequenceFile$Writer.syncFs(SequenceFile.java:999)
        at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.sync(SequenceFileLogWriter.java:248)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1131)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1069)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.sync(FSHLog.java:1239)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog$LogSyncer.run(FSHLog.java:1021)
        at java.lang.Thread.run(Thread.java:662)
{noformat}

v2 removes fixes some side stuff, that what I will commit if no one objects

                  
> Too much logs in the some tests
> -------------------------------
>
>                 Key: HBASE-8305
>                 URL: https://issues.apache.org/jira/browse/HBASE-8305
>             Project: HBase
>          Issue Type: Bug
>          Components: build, test
>    Affects Versions: 0.95.0
>            Reporter: Nicolas Liochon
>            Assignee: Nicolas Liochon
>         Attachments: 8305.v1.patch
>
>
> org.apache.hadoop.hbase.client.TestAdmin-output.txt	235.45 MB
> org.apache.hadoop.hbase.master.TestTableLockManager-output.txt	4.15 MB
> org.apache.hadoop.hbase.regionserver.TestAtomicOperation-output.txt	5.47 MB
> org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction-output.txt	16.07 MB

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message