hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anil gupta <anilgupt...@gmail.com>
Subject Re: Spark on Hbase
Date Thu, 10 Mar 2016 21:37:52 GMT
Apart from Phoenix Spark connector. You can also have a look at:
https://github.com/Huawei-Spark/Spark-SQL-on-HBase

On Wed, Mar 9, 2016 at 4:58 PM, Divya Gehlot <divya.htconex@gmail.com>
wrote:

> I agree with Talat
> As couldn't connect directly with Hbase
> Connecting it through Phoenix .
> If you are using Hortonworks distribution ,it comes with Phoenix.
>
> Thanks,
> Divya
> On Mar 10, 2016 3:04 AM, "Talat Uyarer" <talat@uyarer.com> wrote:
>
> > Hi,
> >
> > Have you ever tried Apache phoenix ? They have spark solution[1]. I
> > have just started to use on spark. I haven't tried it with spark
> > streaming.
> >
> > [1] http://phoenix.apache.org/phoenix_spark.html
> >
> > 2016-03-08 22:04 GMT-08:00 Rachana Srivastava
> > <rachanasrivastav@yahoo.com.invalid>:
> > > I am trying to integrate SparkStreaming with HBase.  I am calling
> > following APIs to connect to HBase
> > >
> > > HConnection hbaseConnection =
> > HConnectionManager.createConnection(conf);hBaseTable =
> > hbaseConnection.getTable(hbaseTable);
> > > Since I cannot get the connection and broadcast the connection each API
> > call to get data from HBase is very expensive.  I tried using
> > JavaHBaseContext (JavaHBaseContext hbaseContext = new
> JavaHBaseContext(jsc,
> > conf)) by using hbase-spark library in CDH 5.5 but I cannot import the
> > library from maven.  Has anyone been able to successfully resolve this
> > issue.
> >
> >
> >
> > --
> > Talat UYARER
> > Websitesi: http://talat.uyarer.com
> > Twitter: http://twitter.com/talatuyarer
> > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >
>



-- 
Thanks & Regards,
Anil Gupta

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message