hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Malaska (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-14181) Add Spark DataFrame DataSource to HBase-Spark Module
Date Fri, 14 Aug 2015 04:23:45 GMT

     [ https://issues.apache.org/jira/browse/HBASE-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ted Malaska updated HBASE-14181:
--------------------------------
    Attachment: HBASE-14181.4.patch

We are getting a lot closer:
- Added more unit testing
- Fixed some bugs in the scan range prunning logic
- Removed println
- Addressed almost all the comments
- Fixed the Serialization with the maps.  It turned out to be a weird Scala thing.

What is left to do:
- The Filter is still using Serialization and needs to be ported to Proto buffers 
- Some more testing

> Add Spark DataFrame DataSource to HBase-Spark Module
> ----------------------------------------------------
>
>                 Key: HBASE-14181
>                 URL: https://issues.apache.org/jira/browse/HBASE-14181
>             Project: HBase
>          Issue Type: New Feature
>          Components: spark
>            Reporter: Ted Malaska
>            Assignee: Ted Malaska
>            Priority: Minor
>         Attachments: HBASE-14181.1.patch, HBASE-14181.2.patch, HBASE-14181.3.patch, HBASE-14181.4.patch
>
>
> Build a RelationProvider for HBase-Spark Module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message