hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Divya Gehlot <divya.htco...@gmail.com>
Subject Re: Spark on Hbase
Date Thu, 10 Mar 2016 00:58:47 GMT
I agree with Talat
As couldn't connect directly with Hbase
Connecting it through Phoenix .
If you are using Hortonworks distribution ,it comes with Phoenix.

Thanks,
Divya
On Mar 10, 2016 3:04 AM, "Talat Uyarer" <talat@uyarer.com> wrote:

> Hi,
>
> Have you ever tried Apache phoenix ? They have spark solution[1]. I
> have just started to use on spark. I haven't tried it with spark
> streaming.
>
> [1] http://phoenix.apache.org/phoenix_spark.html
>
> 2016-03-08 22:04 GMT-08:00 Rachana Srivastava
> <rachanasrivastav@yahoo.com.invalid>:
> > I am trying to integrate SparkStreaming with HBase.  I am calling
> following APIs to connect to HBase
> >
> > HConnection hbaseConnection =
> HConnectionManager.createConnection(conf);hBaseTable =
> hbaseConnection.getTable(hbaseTable);
> > Since I cannot get the connection and broadcast the connection each API
> call to get data from HBase is very expensive.  I tried using
> JavaHBaseContext (JavaHBaseContext hbaseContext = new JavaHBaseContext(jsc,
> conf)) by using hbase-spark library in CDH 5.5 but I cannot import the
> library from maven.  Has anyone been able to successfully resolve this
> issue.
>
>
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message