hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elliott Clark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13992) Integrate SparkOnHBase into HBase
Date Mon, 29 Jun 2015 20:07:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606289#comment-14606289
] 

Elliott Clark commented on HBASE-13992:
---------------------------------------

I really like the idea. Spark streaming and HBase make some great sense together.

Thoughts on the code as it is currently:

* Need to scrub/remove cdh and cloudera references.
* Seems really messy as far as structure/layout.
** Why javatest/ and src/test/java
** Why java/ and src/main/java
** Single random scala file in root dir?
* Tons of ide files in here.
* Everything is named example. These should all be bases ( either extendable base classes
or scala traits )
* Why java when most of spark is scala?
* Needs some serious work on java/scala docing.

> Integrate SparkOnHBase into HBase
> ---------------------------------
>
>                 Key: HBASE-13992
>                 URL: https://issues.apache.org/jira/browse/HBASE-13992
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Ted Malaska
>            Assignee: Ted Malaska
>              Labels: spark
>
> This Jira is to ask if SparkOnHBase can find a home in side HBase core.
> Here is the github: 
> https://github.com/cloudera-labs/SparkOnHBase
> I am the core author of this project and the license is Apache 2.0
> A blog explaining this project is here
> http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
> A spark Streaming example is here
> http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
> A real customer using this in produce is blogged here
> http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/
> Please debate and let me know what I can do to make this happen.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message