hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <apurt...@apache.org>
Subject Re: precommit exception when opening HFiles.
Date Wed, 16 Jan 2013 23:37:25 GMT
I'll try a few things on HBASE-7594


On Wed, Jan 16, 2013 at 3:36 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> From https://builds.apache.org/job/PreCommit-HBASE-Build/4057/consoleFull:
>
>
> [PreCommit-HBASE-Build] $ /bin/bash
> /tmp/hudson2696208886865701786.shasf002.sp2.ygridcore.net
> Linux asf002.sp2.ygridcore.net 2.6.32-33-server #71-Ubuntu SMP Wed Jul
> 20 17:42:25 UTC 2011 x86_64 GNU/Linux
> core file size          (blocks, -c) 0
> data seg size           (kbytes, -d) unlimited
> scheduling priority             (-e) 20
> file size               (blocks, -f) unlimited
> pending signals                 (-i) 16382
> max locked memory       (kbytes, -l) 64
> max memory size         (kbytes, -m) unlimited
> open files                      (-n) 60000
> pipe size            (512 bytes, -p) 8
> POSIX message queues     (bytes, -q) 819200
> real-time priority              (-r) 0
> stack size              (kbytes, -s) 8192
> cpu time               (seconds, -t) unlimited
> max user processes              (-u) 10240
> virtual memory          (kbytes, -v) unlimited
> file locks                      (-x) unlimited
> 60000
> Running in Jenkins mode
>
>
> I added 'java -version' to the above list - effective in next build.
>
>
> Jenkins says Java 1.7 latest
>
>
> Cheers
>
>
> On Wed, Jan 16, 2013 at 3:28 PM, Andrew Purtell <apurtell@apache.org>
> wrote:
>
> > Two theories:
> >
> > 1) There is junk in /tmp/hbase-${user.name} from an earlier test picked
> up
> > by the build.
> >
> > 2) This is something specific to the JRE version or the local environment
> > on hadoopqa.
> >
> > I think Ted updated the precommit build config to rm -rf /tmp/hbase-*
> ahead
> > of testing.
> >
> > For the second, it could be useful to dump out uname -a and java -version
> > ahead of running the build?
> >
> >
> > On Wed, Jan 16, 2013 at 3:17 PM, Stack <stack@duboce.net> wrote:
> >
> > > Easy enough to test by running a patch by hadoopqa?
> >  TestLocalHBaseCluster
> > > is failing w/ the above most of the time?
> > >
> > > Good on you,
> > > St.Ack
> > >
> > >
> > > On Wed, Jan 16, 2013 at 3:07 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> > >
> > > > For TestLocalHBaseCluster test failure, the only explanation I can
> come
> > > up
> > > > with is that in deserializeFromWritable(), majorVersion was <= 1.
> This
> > > > would result in comparatorClassName not assigned (to concrete
> > comparator
> > > > classname) due to the following check (line 366):
> > > >
> > > >     if (majorVersion > 1) {
> > > >
> > > > Cheers
> > > >
> > > > On Wed, Jan 16, 2013 at 3:02 PM, lars hofhansl <larsh@apache.org>
> > wrote:
> > > >
> > > > > In some of the failed test logs in trunk precommit I see these.
> > > > > Look bad. Is that something to worry about?
> > > > >
> > > > >
> > > > > java.io.IOException: java.io.IOException: java.io.IOException:
> > > > > java.lang.InstantiationException:
> org.apache.hadoop.io.RawComparator
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> > > > >     at
> > > > >
> > >
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4086)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4036)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> > > > >     at
> > > > >
> > >
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> > > > >     at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > > > >     at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > > > >     at java.lang.Thread.run(Thread.java:662)
> > > > > Caused by: java.io.IOException: java.io.IOException:
> > > > > java.lang.InstantiationException:
> org.apache.hadoop.io.RawComparator
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
> > > > >     at
> > > > org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:215)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
> > > > >     at
> > > > >
> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
> > > > >     at
> > > > >
> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
> > > > >     at
> > > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > > > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > > > >     at
> > > > >
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> > > > >     at
> > > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > > > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > > > >     ... 3 more
> > > > > Caused by: java.io.IOException: java.lang.InstantiationException:
> > > > > org.apache.hadoop.io.RawComparator
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.<init>(HFileReaderV2.java:115)
> > > > >     at
> > > > >
> > >
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1294)
> > > > >     at
> > > > >
> > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
> > > > >     at
> > > > org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426)
> > > > >     at
> > > > org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422)
> > > > >     ... 8 more
> > > > > Caused by: java.lang.InstantiationException:
> > > > > org.apache.hadoop.io.RawComparator
> > > > >     at java.lang.Class.newInstance0(Class.java:340)
> > > > >     at java.lang.Class.newInstance(Class.java:308)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605)
> > > > >     ... 17 more
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> >    - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message