hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhan Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector
Date Thu, 17 Mar 2016 01:11:33 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhan Zhang updated HBASE-15334:
-------------------------------
    Description: 
Avro is a popular format for hbase storage. User may want the support natively in the connector.

With the support, user can save serialized avro into hbase table, and then query on top of
it using spark sql.  The conversion between avro and catalyst datatype will be handled automatically.
This is one way of support complex data types. Otherwise, user has to define their own customized
Serdes to support complex data types.

  was:
Avro is a popular format for hbase storage. User may want the support natively in the connector.

With the support, user can save serialized avro into hbase table, and then query on top of
it using spark sql. This is one way of support complex data types automatically supported.
Otherwise, user has to define their own customized Serdes to support complex data types.


> Add avro support for spark hbase connector
> ------------------------------------------
>
>                 Key: HBASE-15334
>                 URL: https://issues.apache.org/jira/browse/HBASE-15334
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Zhan Zhang
>            Assignee: Zhan Zhang
>         Attachments: HBASE-15334-1.patch, HBASE-15334-2.patch, HBASE-15334-3.patch, HBASE-15334-4.patch,
HBASE-15334-5.patch
>
>
> Avro is a popular format for hbase storage. User may want the support natively in the
connector.
> With the support, user can save serialized avro into hbase table, and then query on top
of it using spark sql.  The conversion between avro and catalyst datatype will be handled
automatically. This is one way of support complex data types. Otherwise, user has to define
their own customized Serdes to support complex data types.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message