crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-475) Compilation problem caused by KeyValue -> Cell conversion
Date Tue, 14 Oct 2014 02:54:34 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170421#comment-14170421
] 

Micah Whitacre commented on CRUNCH-475:
---------------------------------------

{quote}
However, dislike to KeyValue, there is no concrete state to be serialized / deserialized.
I don't know how to replace HBaseTypes#bytesToKeyValue and HBaseTypes#keyValueToBytes.

May I assume that the Cell object in WritableType<Cell> is actually KeyValue object?
{quote}

In the patch I found that I had to revert Cell back to using the KeyValue Writable methods
for serialization because that type is used for reading payloads out of an HFile.  Using the
ProtobufUtil/ClientProtos.Cell classes will probably be what we use for serialization in later
versions of HBase but we'd need the HFile format to change before we could make that change.

> Compilation problem caused by KeyValue -> Cell conversion
> ---------------------------------------------------------
>
>                 Key: CRUNCH-475
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-475
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.12.0
>            Reporter: Lee Dongjin
>            Assignee: Josh Wills
>            Priority: Minor
>         Attachments: CRUNCH-475.patch
>
>
> From hbase 0.99, Using KeyValue class for hbase I/O is deprecated and in many APIs it
was replaced with Cell interface[^1][^2][^3]. This change causes compilation error with hbase
0.99, which is the first hbase version that supports hadoop 2 only.
> For this change will be permanent from hbase 1.0 and on, it would be better to be fixed.
> [^1]: https://issues.apache.org/jira/browse/HBASE-11805
> [^2]: https://issues.apache.org/jira/browse/HBASE-9359
> [^3]: https://issues.apache.org/jira/browse/HBASE-10526



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message