hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abinash Karana \(Bizosys\)" <abin...@bizosys.com>
Subject RE: java.lang.NoSuchMethodException: hbase-0.90
Date Mon, 17 Jan 2011 02:58:55 GMT
Here goes the exception details.. I again encountered... 

 

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$mutateRowsTs_result$1.class

11/01/16 20:22:59 INFO wal.HLogSplitter: Split writers finished

11/01/16 20:22:59 ERROR master.MasterFileSystem: Failed splitting
file:/tmp/hbase-karan/hbase/.logs/abinash,3620,1295188307109

java.io.IOException: Unable to delete src dir:
file:/tmp/hbase-karan/hbase/.logs/abinash,3620,1295188307109

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.archiveLogs(HLogSplitt
er.java:341)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:290)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:187)

        at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja
va:196)

        at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF
ileSystem.java:180)

        at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378
)

        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277)

        at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo
mmandLine.java:193)

        at java.lang.Thread.run(Unknown Source)

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$Iface.class

11/01/16 20:22:59 INFO master.MasterFileSystem: Log folder
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984 doesn't belong
to a known regi

on server, splitting

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$deleteAllTs_args.class

11/01/16 20:22:59 INFO wal.HLogSplitter: Splitting 1 hlog(s) in
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$Processor$atomicIncrement.cla
ss

11/01/16 20:22:59 DEBUG wal.HLogSplitter: Splitting hlog 1 of 1:
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
129518950

2031, length=8192

11/01/16 20:22:59 WARN util.FSUtils: Running on HDFS without append enabled
may result in data loss

11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread
Thread[WriterThread-0,6,main]: starting

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$mutateRow_args$_Fields.class

11/01/16 20:22:59 WARN fs.FSInputChecker: Problem opening checksum file:
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
1

295189502031.  Ignoring exception: java.io.EOFException

        at java.io.DataInputStream.readFully(Unknown Source)

        at java.io.DataInputStream.readFully(Unknown Source)

        at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(Checks
umFileSystem.java:134)

        at
org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)

        at
org.apache.hadoop.io.SequenceFile$Reader.openFile(SequenceFile.java:1444)

        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.ope
nFile(SequenceFileLogReader.java:65)

        at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1431)

        at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424)

        at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1419)

        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<in
it>(SequenceFileLogReader.java:57)

        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(Sequence
FileLogReader.java:158)

        at
org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:576)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter
.java:469)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.parseHLog(HLogSplitter
.java:406)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:261)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:187)

        at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja
va:196)

        at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF
ileSystem.java:180)

        at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378
)

        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277)

        at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo
mmandLine.java:193)

        at java.lang.Thread.run(Unknown Source)

 

11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread
Thread[WriterThread-2,6,main]: starting

11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread
Thread[WriterThread-1,6,main]: starting

11/01/16 20:22:59 WARN wal.SequenceFileLogReader: Error while trying to get
accurate file length.  Truncation / data loss may occur if RegionServers d

ie.

java.lang.NoSuchMethodException:
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.getFileLength
()

        at java.lang.Class.getMethod(Unknown Source)

        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader$WAL
ReaderFSDataInputStream.getPos(SequenceFileLogReader.java:107)

        at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1434)

        at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424)

        at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1419)

        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<in
it>(SequenceFileLogReader.java:57)

        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(Sequence
FileLogReader.java:158)

        at
org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:576)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter
.java:469)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.parseHLog(HLogSplitter
.java:406)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:261)

        at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:187)

        at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja
va:196)

        at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF
ileSystem.java:180)

        at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378
)

        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277)

        at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo
mmandLine.java:193)

        at java.lang.Thread.run(Unknown Source)

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$getColumnDescriptors_result$1
.class

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$scannerOpenWithPrefix_result$
_Fields.class

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftServer$HBaseHandler$1.class

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftServer$HBaseHandler.class

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftUtilities.class

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftServer.class

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/HColumnDescriptor$CompressionType.class

11/01/16 20:22:59 DEBUG wal.HLogSplitter: Pushed=31 entries from
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
129518950

2031

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/LICENSE

11/01/16 20:22:59 INFO wal.HLogSplitter: EOF from hlog
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
1295189502031.  con

tinuing

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/NOTICE

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/DEPENDENCIES

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
hbase-webapps/master/index.html

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
hbase-webapps/master/WEB-INF/web.xml

11/01/16 20:22:59 INFO wal.SequenceFileLogWriter: syncFs -- HDFS-200 -- not
available, dfs.support.append=false

11/01/16 20:22:59 DEBUG wal.HLogSplitter: Creating writer
path=file:/tmp/hbase-karan/hbase/-ROOT-/70236052/recovered.edits/00000000000
00002697 region=

70236052

11/01/16 20:22:59 INFO wal.HLogSplitter: Archived processed log
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
1295189502

031 to file:/tmp/hbase-karan/hbase/.oldlogs/abinash%3A4030.1295189502031

11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
hbase-webapps/static/hbase_logo_med.gif

 

-----Original Message-----
From: Ted Dunning [mailto:tdunning@maprtech.com] 
Sent: Saturday, January 08, 2011 2:28 AM
To: dev@hbase.apache.org
Subject: Re: java.lang.NoSuchMethodException: hbase-0.90

 

Great.  I will file a patch to move the check to the constructor and fail

back to

old process if the method is missing.

 

For our case, I just implemented getFileLength and all is happy (on that

front)

 

On Fri, Jan 7, 2011 at 12:38 PM, Stack <stack@duboce.net> wrote:

 

> Let me open an issue to add more checks around the reflection; e.g.

> check type as you fellas suggest.  If anything is not as expected,

> then we'd fallback on old getPos behavior.  It should not fail for

> 'pure' HDFS.  'Alternative' HDFS's probably don't have this 2G

> problem.

>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message