hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sudhir patil <spatil.sud...@gmail.com>
Subject Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0
Date Sat, 23 Apr 2016 00:01:31 GMT
Connecting to kerborised hbase from spark is fixed in spark 1.4 , don't
think 1.3 works because kerberos issues.
https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-6918
On Apr 23, 2016 5:35 AM, "Sean Busbey" <busbey@cloudera.com> wrote:

> The HBase-Downstreamer project has an example that uses the Java API
> for Spark Streaming on a secure cluster:
>
>
> https://github.com/saintstack/hbase-downstreamer#spark-streaming-test-application
>
> https://s.apache.org/apvQ
>
> We'd greatly like a Scala version.
>
> On Fri, Apr 22, 2016 at 4:16 PM, Nkechi Achara <nkachara@googlemail.com>
> wrote:
> > scala API, although Java should be easy to alter.... Also, the cluster is
> > kerberized 😣
> >
> > On 22 April 2016 at 22:34, Sean Busbey <busbey@cloudera.com> wrote:
> >
> >> Are you attempting to use Spark's Java API or its Scala API? (or python,
> >> etc?)
> >>
> >> On Fri, Apr 22, 2016 at 2:24 PM, Nkechi Achara <nkachara@googlemail.com
> >
> >> wrote:
> >> > Hi,
> >> >
> >> > I am attempting to use both SpakOnHbase and Hbase-Spark, but I keep
> >> > receiving dependency isues, and I am not sure if any of these
> connectors
> >> > are available for Spark 1.3 / Hadoop 2.6 / Hbase 1.0.
> >> >
> >> > Has anyone got a new library I can use, or a concrete example to use?
> >> >
> >> > Thanks,
> >> >
> >> > Keech
> >>
> >>
> >>
> >> --
> >> busbey
> >>
>
>
>
> --
> busbey
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message