hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: precommit exception when opening HFiles.
Date Wed, 16 Jan 2013 23:36:24 GMT
>From https://builds.apache.org/job/PreCommit-HBASE-Build/4057/consoleFull :


[PreCommit-HBASE-Build] $ /bin/bash
/tmp/hudson2696208886865701786.shasf002.sp2.ygridcore.net
Linux asf002.sp2.ygridcore.net 2.6.32-33-server #71-Ubuntu SMP Wed Jul
20 17:42:25 UTC 2011 x86_64 GNU/Linux
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 20
file size               (blocks, -f) unlimited
pending signals                 (-i) 16382
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 60000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 10240
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
60000
Running in Jenkins mode


I added 'java -version' to the above list - effective in next build.


Jenkins says Java 1.7 latest


Cheers


On Wed, Jan 16, 2013 at 3:28 PM, Andrew Purtell <apurtell@apache.org> wrote:

> Two theories:
>
> 1) There is junk in /tmp/hbase-${user.name} from an earlier test picked up
> by the build.
>
> 2) This is something specific to the JRE version or the local environment
> on hadoopqa.
>
> I think Ted updated the precommit build config to rm -rf /tmp/hbase-* ahead
> of testing.
>
> For the second, it could be useful to dump out uname -a and java -version
> ahead of running the build?
>
>
> On Wed, Jan 16, 2013 at 3:17 PM, Stack <stack@duboce.net> wrote:
>
> > Easy enough to test by running a patch by hadoopqa?
>  TestLocalHBaseCluster
> > is failing w/ the above most of the time?
> >
> > Good on you,
> > St.Ack
> >
> >
> > On Wed, Jan 16, 2013 at 3:07 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> >
> > > For TestLocalHBaseCluster test failure, the only explanation I can come
> > up
> > > with is that in deserializeFromWritable(), majorVersion was <= 1. This
> > > would result in comparatorClassName not assigned (to concrete
> comparator
> > > classname) due to the following check (line 366):
> > >
> > >     if (majorVersion > 1) {
> > >
> > > Cheers
> > >
> > > On Wed, Jan 16, 2013 at 3:02 PM, lars hofhansl <larsh@apache.org>
> wrote:
> > >
> > > > In some of the failed test logs in trunk precommit I see these.
> > > > Look bad. Is that something to worry about?
> > > >
> > > >
> > > > java.io.IOException: java.io.IOException: java.io.IOException:
> > > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> > > >     at
> > > >
> > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4086)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4036)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> > > >     at
> > > >
> > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> > > >     at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > > >     at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > > >     at java.lang.Thread.run(Thread.java:662)
> > > > Caused by: java.io.IOException: java.io.IOException:
> > > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
> > > >     at
> > > org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:215)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
> > > >     at
> > > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
> > > >     at
> > > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
> > > >     at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > > >     at
> > > >
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> > > >     at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > > >     ... 3 more
> > > > Caused by: java.io.IOException: java.lang.InstantiationException:
> > > > org.apache.hadoop.io.RawComparator
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.<init>(HFileReaderV2.java:115)
> > > >     at
> > > >
> > org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1294)
> > > >     at
> > > >
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
> > > >     at
> > > org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426)
> > > >     at
> > > org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422)
> > > >     ... 8 more
> > > > Caused by: java.lang.InstantiationException:
> > > > org.apache.hadoop.io.RawComparator
> > > >     at java.lang.Class.newInstance0(Class.java:340)
> > > >     at java.lang.Class.newInstance(Class.java:308)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605)
> > > >     ... 17 more
> > > >
> > >
> >
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message