hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14181) Add Spark DataFrame DataSource to HBase-Spark Module
Date Thu, 27 Aug 2015 16:01:48 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716926#comment-14716926

Sean Busbey commented on HBASE-14181:

>From [~apurtell] on RB:

Have you looked at the types library? See org.apache.hadoop.hbase.types in hbase-common. Should
this share that code/representation for interoperability with types library users? Note the
Raw* types are equivalent to encodings made by Bytes.toBytes(<type>). The DataType type
in that package handles encoding of row keys and column qualifiers with typed data.

Looking at the current patch, it's still relying on the Bytes utility directly rather than
the hbase datatypes library. Did you get a chance to look at this as an alternative Ted? Was
there a particular rationale for picking one over the other?

> Add Spark DataFrame DataSource to HBase-Spark Module
> ----------------------------------------------------
>                 Key: HBASE-14181
>                 URL: https://issues.apache.org/jira/browse/HBASE-14181
>             Project: HBase
>          Issue Type: New Feature
>          Components: spark
>            Reporter: Ted Malaska
>            Assignee: Ted Malaska
>            Priority: Minor
>         Attachments: HBASE-14181.1.patch, HBASE-14181.2.patch, HBASE-14181.3.patch, HBASE-14181.4.patch,
HBASE-14181.5.patch, HBASE-14181.6.patch, HBASE-14181.7.patch
> Build a RelationProvider for HBase-Spark Module.

This message was sent by Atlassian JIRA

View raw message