incubator-gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lewis john mcgibbney <lewis.mcgibb...@gmail.com>
Subject Re: HBase store initialization of table without configuration in constructor
Date Tue, 11 Oct 2011 20:33:52 GMT
Hi Dino,

That's excellent thanks for providing your insight into this. I think once
we can try a patch out (and hopefully get the HBase module fully functional)
then we are well on the way to getting a stable CI build on the go.

Thank you

Lewis

On Tue, Oct 11, 2011 at 9:22 PM, Dino Kečo <dino.keco@gmail.com> wrote:

> I have created ticket GORA-48<
> https://issues.apache.org/jira/browse/GORA-48>
> I have proposed my solution in defect description. Is that OK or should I
> do
> something else ?
> Not sure what is problem with your CI build but I will definitely try to
> resolve it. If I find something I will let you know.
>
> thanks,
> dinok
>
>
> On Tue, Oct 11, 2011 at 6:30 PM, lewis john mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
>
> > Hi Dino,
> >
> > Would it be possible to ask you to open a Jira on this issue? If you can
> > submit an initial patch then we could try it out. To be honest my initial
> > feelings are that you have identified the problem area, the maven CI
> builds
> > would reflect this. The HBase module is tripping with the following
> output
> >
> > 11/10/11 05:45:54 INFO regionserver.HRegionServer: Master isn't
> > available yet, retrying
> > 11/10/11 05:45:56 INFO datanode.DataNode: using BLOCKREPORT_INTERVAL
> > of 3600000msec Initial delay: 0msec
> > 11/10/11 05:45:56 ERROR datanode.DataNode: Exception:
> > java.lang.NullPointerException
> >        at
> >
> org.apache.hadoop.hdfs.server.datanode.FSDataset$FSDir.getBlockInfo(FSDataset.java:188)
> >        at
> >
> org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.getBlockInfo(FSDataset.java:429)
> >
> >        at
> >
> org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolumeSet.getBlockInfo(FSDataset.java:527)
> >        at
> >
> org.apache.hadoop.hdfs.server.datanode.FSDataset.getBlockReport(FSDataset.java:1216)
> >        at
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.offerService(DataNode.java:755)
> >        at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.run(DataNode.java:1186)
> >        at java.lang.Thread.run(Thread.java:619)
> >
> > Does any of this look familiar guys?
> >
> > On Tue, Oct 11, 2011 at 3:24 PM, Dino Kečo <dino.keco@gmail.com> wrote:
> >
> > > Hi guys,
> > >
> > > I have been playing around with HBaseStorage (latest code from TRUNK)
> and
> > I
> > > have noticed one thing which could be defect.
> > >
> > > Initialize method from HBaseStorage
> > >
> > >  public void initialize(Class<K> keyClass, Class<T> persistentClass,
> > >      Properties properties) throws IOException {
> > >    super.initialize(keyClass, persistentClass, properties);
> > >    this.conf = HBaseConfiguration.create(getConf());
> > >
> > >    admin = new HBaseAdmin(this.conf);
> > >
> > >    try {
> > >      mapping = readMapping(getConf().get(PARSE_MAPPING_FILE_KEY,
> > > DEFAULT_MAPPING_FILE));
> > >    } catch (FileNotFoundException ex) {
> > >      try {
> > >        mapping = readMapping(getConf().get(PARSE_MAPPING_FILE_KEY,
> > > DEPRECATED_MAPPING_FILE));
> > >        log.warn(DEPRECATED_MAPPING_FILE + " is deprecated, please
> rename
> > > the file to "
> > >            + DEFAULT_MAPPING_FILE);
> > >      } catch (FileNotFoundException ex1) {
> > >        throw ex; //throw the original exception
> > >      } catch (Exception ex1) {
> > >        log.warn(DEPRECATED_MAPPING_FILE + " is deprecated, please
> rename
> > > the file to "
> > >            + DEFAULT_MAPPING_FILE);
> > >        throw new RuntimeException(ex1);
> > >      }
> > >    } catch (Exception e) {
> > >      throw new RuntimeException(e);
> > >    }
> > >    if(autoCreateSchema) {
> > >      createSchema();
> > >    }
> > >
> > >    table = new HTable(mapping.getTableName());
> > >  }
> > >
> > > is creating HTable without configuration parameter which is causing
> this
> > > error:
> > >
> > > java.net.ConnectException: Connection refused: no further information
> > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
> > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
> > > 11/10/11 16:22:33 INFO zookeeper.ClientCnxn: Opening socket connection
> to
> > > server localhost/0:0:0:0:0:0:0:1:2181
> > >
> > > In my opinion HTable should be created using  this code:
> > >
> > >  table = new HTable(conf, mapping.getTableName());
> > >
> > > What do you think about this ?
> > >
> > > Regards,
> > > dinok
> > >
> >
> >
> >
> > --
> > *Lewis*
> >
>



-- 
*Lewis*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message