hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-550) EOF trying to read reconstruction log stops region deployment
Date Sat, 29 Mar 2008 17:45:24 GMT

    [ https://issues.apache.org/jira/browse/HBASE-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583344#action_12583344
] 

stack commented on HBASE-550:
-----------------------------

Here is the infinite loop the above exception makes as seen from the master log:

{code}
2008-03-29 10:44:30,239 DEBUG org.apache.hadoop.hbase.HMaster: Main processing loop: ProcessRegionClose
of pdc-docs,EP02075940NWA2,1205761493128, true, false
2008-03-29 10:44:30,239 INFO org.apache.hadoop.hbase.HMaster: region closed: pdc-docs,EP02075940NWA2,1205761493128
2008-03-29 10:44:30,239 INFO org.apache.hadoop.hbase.HMaster: reassign region: pdc-docs,EP02075940NWA2,1205761493128
2008-03-29 10:44:33,146 INFO org.apache.hadoop.hbase.HMaster: assigning region pdc-docs,EP02075940NWA2,1205761493128
to server 192.168.105.43:60020
2008-03-29 10:44:36,150 DEBUG org.apache.hadoop.hbase.HMaster: Received MSG_REPORT_PROCESS_OPEN
: pdc-docs,EP02075940NWA2,1205761493128 from 192.168.105.43:60020
2008-03-29 10:44:36,151 DEBUG org.apache.hadoop.hbase.HMaster: Received MSG_REPORT_CLOSE :
pdc-docs,EP02075940NWA2,1205761493128 from 192.168.105.43:60020
2008-03-29 10:44:36,151 INFO org.apache.hadoop.hbase.HMaster: 192.168.105.43:60020 no longer
serving regionname: pdc-docs,EP02075940NWA2,1205761493128, startKey: <EP02075940NWA2>,
endKey: <EP02080373NWA2>, encodedName: 456923460, tableDesc: {name: pdc-docs, families:
{contents:={name: contents, max versions: 3, compression: NONE, in memory: false, max length:
2147483647, bloom filter: none}, language:={name: language, max versions: 3, compression:
NONE, in memory: false, max length: 2147483647, bloom filter: none}, mimetype:={name: mimetype,
max versions: 3, compression: NONE, in memory: false, max length: 2147483647, bloom filter:
none}}}
2008-03-29 10:44:36,154 DEBUG org.apache.hadoop.hbase.HMaster: Main processing loop: ProcessRegionClose
of pdc-docs,EP02075940NWA2,1205761493128, true, false
2008-03-29 10:44:36,154 INFO org.apache.hadoop.hbase.HMaster: region closed: pdc-docs,EP02075940NWA2,1205761493128
2008-03-29 10:44:36,154 INFO org.apache.hadoop.hbase.HMaster: reassign region: pdc-docs,EP02075940NWA2,1205761493128
2008-03-29 10:44:36,243 INFO org.apache.hadoop.hbase.HMaster: assigning region pdc-docs,EP02075940NWA2,1205761493128
to server 192.168.105.49:60020
2008-03-29 10:44:39,248 DEBUG org.apache.hadoop.hbase.HMaster: Received MSG_REPORT_PROCESS_OPEN
: pdc-docs,EP02075940NWA2,1205761493128 from 192.168.105.49:60020
2008-03-29 10:44:39,249 DEBUG org.apache.hadoop.hbase.HMaster: Received MSG_REPORT_CLOSE :
pdc-docs,EP02075940NWA2,1205761493128 from 192.168.105.49:60020
2008-03-29 10:44:39,249 INFO org.apache.hadoop.hbase.HMaster: 192.168.105.49:60020 no longer
serving regionname: pdc-docs,EP02075940NWA2,1205761493128, startKey: <EP02075940NWA2>,
endKey: <EP02080373NWA2>, encodedName: 456923460, tableDesc: {name: pdc-docs, families:
{contents:={name: contents, max versions: 3, compression: NONE, in memory: false, max length:
2147483647, bloom filter: none}, language:={name: language, max versions: 3, compression:
NONE, in memory: false, max length: 2147483647, bloom filter: none}, mimetype:={name: mimetype,
max versions: 3, compression: NONE, in memory: false, max length: 2147483647, bloom filter:
none}}}
2008-03-29 10:44:39,251 DEBUG org.apache.hadoop.hbase.HMaster: Main processing loop: ProcessRegionClose
of pdc-docs,EP02075940NWA2,1205761493128, true, false
2008-03-29 10:44:39,251 INFO org.apache.hadoop.hbase.HMaster: region closed: pdc-docs,EP02075940NWA2,1205761493128
2008-03-29 10:44:39,251 INFO org.apache.hadoop.hbase.HMaster: reassign region: pdc-docs,EP02075940NWA2,1205761493128
{code}

A concurrent uploading is failing because regions never make it online (This is Lars' cluster).

> EOF trying to read reconstruction log stops region deployment
> -------------------------------------------------------------
>
>                 Key: HBASE-550
>                 URL: https://issues.apache.org/jira/browse/HBASE-550
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.16.0, 0.1.0
>            Reporter: stack
>            Priority: Blocker
>
> Regions are just being reallocated over and over again because log file is hosed:
> {code}
> 2008-03-29 10:37:53,762 ERROR org.apache.hadoop.hbase.HRegionServer: error opening region
pdc-docs,EP92114798NWA1,1205741702057
> java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:178)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1421)
>         at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1398)
>         at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1387)
>         at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1382)
>         at org.apache.hadoop.hbase.HStore.doReconstructionLog(HStore.java:839)
>         at org.apache.hadoop.hbase.HStore.<init>(HStore.java:773)
>         at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:389)
>         at org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:1159)
       at org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1105)
>         at java.lang.Thread.run(Thread.java:595)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message