hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jimmy Xiang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6443) HLogSplitter should ignore 0 length files
Date Fri, 17 Aug 2012 22:25:38 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13437115#comment-13437115
] 

Jimmy Xiang commented on HBASE-6443:
------------------------------------

Looked into it again.  A normal empty hlog file doesn't cause a problem with log splitting.
 Only if the file is corrupted somehow, it causes problems:

{noformat}
java.io.IOException: Could not obtain the last block locations.
at org.apache.hadoop.hdfs.DFSInputStream.openInfo(DFSInputStream.java:138)
at org.apache.hadoop.hdfs.DFSInputStream.<init>(DFSInputStream.java:112)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:939)
at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:212)
at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:75)
at org.apache.hadoop.io.SequenceFile$Reader.openFile(SequenceFile.java:1768)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.openFile(SequenceFileLogReader.java:66)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1688)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1709)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:58)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(SequenceFileLogReader.java:166)
at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:659)
at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter.java:846)
at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter.java:759)
at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFileToTemp(HLogSplitter.java:384)

{noformat}

If I manually ceate an empty hlog file, log splitting can handle it properly with no problem.
 
                
> HLogSplitter should ignore 0 length files
> -----------------------------------------
>
>                 Key: HBASE-6443
>                 URL: https://issues.apache.org/jira/browse/HBASE-6443
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0, 0.94.1
>
>
> Somehow, some WAL files have size 0. Distributed log splitting can't handle it.
> HLogSplitter should ignore them.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message