hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: How to Intgrate HBase With SparkStreaming
Date Thu, 10 Mar 2016 15:53:52 GMT
Have you looked and tried this?
https://hbase.apache.org/book.html#_spark_streaming

It doesn't work for you?

JMS

2016-03-10 9:36 GMT-05:00 Rachana Srivastava <
rachanasrivastav@yahoo.com.invalid>:

> Hello all,
> I am trying to integrate HBase with SparkStreaming new APIs mentioned here
> http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
> I am using    JavaHBaseContext hbaseContext = new
> JavaHBaseContext(jssc.sparkContext(), conf);  Then called bulk Get API
> hbaseContext.streamBulkGet(TableName.valueOf(tableName), 2, lines, new
> GetFunction2(), new ResultFunction());
>
> But this bulk API is invoked during initialization not during each
> streaming message.   Also used
>
> hbaseContext.foreachPartition(jDStream,new
> VoidFunction<Tuple2<Iterator<String>, Connection>>() {
>       public void call(Tuple2<Iterator<String>, Connection> t)throws
> Exception { ...}
> The API exists but somehow it  is not working for streaming message.
> Do we have example of how to get data using the spark streaming api.
> Thanks,
> Rachana
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message