hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: Spark on Hbase
Date Wed, 09 Mar 2016 19:04:01 GMT
Rachana, is that a dev environment? Do you hve a hard constraint to CDH
5.5? If no, can you try to pull CDH 5.7 instead? It's not yet released but
some snapshots seems to be available and spark works pretty fine with it. I
just build few examples successfully.

HTH.

JMS

2016-03-09 14:00 GMT-05:00 Sean Busbey <busbey@cloudera.com>:

> Hi Rachana!
>
> Better support for Spark users who wish to interact with HBase hasn't made
> it into an HBase release yet. It's still in our development area awaiting
> the last few touches before it makes it into our release line. Our last
> goal was to get it into the upcoming HBase 1.3.
>
> If you are relying on some intermediate solution from a vendor, you should
> check with that vendor's support or community area.
>
> On Tue, Mar 8, 2016 at 10:04 PM, Rachana Srivastava <
> rachanasrivastav@yahoo.com.invalid> wrote:
>
> > I am trying to integrate SparkStreaming with HBase.  I am calling
> > following APIs to connect to HBase
> >
> > HConnection hbaseConnection =
> > HConnectionManager.createConnection(conf);hBaseTable =
> > hbaseConnection.getTable(hbaseTable);
> > Since I cannot get the connection and broadcast the connection each API
> > call to get data from HBase is very expensive.  I tried using
> > JavaHBaseContext (JavaHBaseContext hbaseContext = new
> JavaHBaseContext(jsc,
> > conf)) by using hbase-spark library in CDH 5.5 but I cannot import the
> > library from maven.  Has anyone been able to successfully resolve this
> > issue.
> >
>
>
>
> --
> busbey
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message