Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Fri, 17 Jul 2015 13:59:06 +0000 (UTC)
From: "Ted Malaska (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.12841415.1435604548000.215900.1437141546354@Atlassian.JIRA>
In-Reply-To: <JIRA.12841415.1435604548000@Atlassian.JIRA>
References: <JIRA.12841415.1435604548000@Atlassian.JIRA>
 <JIRA.12841415.1435604548215@arcas>
Subject: [jira] [Commented] (HBASE-13992) Integrate SparkOnHBase into HBase
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14631369#comment-14631369 ] 

Ted Malaska commented on HBASE-13992:
-------------------------------------

[~lhofhansl]
* I will add the comments
* As for the Result you do get the results but you need to convert it to something that can go into an RDD.
* As for the memory needed.  Think of it as if you are reading a file from S3 or HDFS.  It is the same thing here.
* Yes I tested 1.4 with -D and it seemed to work.  

And yes I'm super excited about this too, because this is only the beginning.

I will work through the weekend to get all these reviews into the next patch.

> Integrate SparkOnHBase into HBase
> ---------------------------------
>
>                 Key: HBASE-13992
>                 URL: https://issues.apache.org/jira/browse/HBASE-13992
>             Project: HBase
>          Issue Type: New Feature
>          Components: spark
>            Reporter: Ted Malaska
>            Assignee: Ted Malaska
>             Fix For: 2.0.0
>
>         Attachments: HBASE-13992.patch, HBASE-13992.patch.3, HBASE-13992.patch.4
>
>
> This Jira is to ask if SparkOnHBase can find a home in side HBase core.
> Here is the github: 
> https://github.com/cloudera-labs/SparkOnHBase
> I am the core author of this project and the license is Apache 2.0
> A blog explaining this project is here
> http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
> A spark Streaming example is here
> http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
> A real customer using this in produce is blogged here
> http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/
> Please debate and let me know what I can do to make this happen.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)