crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lee Dongjin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-475) Compilation problem caused by KeyValue -> Cell conversion
Date Mon, 13 Oct 2014 13:24:33 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169279#comment-14169279
] 

Lee Dongjin commented on CRUNCH-475:
------------------------------------

I almost completed the patch, but get stuck on one problem: KeyValue -> Cell conversion
requires modification on serialization / deserialization logic, which is implemented in org.apache.crunch.io.hbase.HBaseTypes.
However, dislike to KeyValue, there is no concrete state to be serialized / deserialized.
I don't know how to replace HBaseTypes#bytesToKeyValue and HBaseTypes#keyValueToBytes.

May I assume that the Cell object in WritableType<Cell> is actually KeyValue object?

> Compilation problem caused by KeyValue -> Cell conversion
> ---------------------------------------------------------
>
>                 Key: CRUNCH-475
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-475
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.12.0
>            Reporter: Lee Dongjin
>            Assignee: Josh Wills
>            Priority: Minor
>
> From hbase 0.99, Using KeyValue class for hbase I/O is deprecated and in many APIs it
was replaced with Cell interface[^1][^2][^3]. This change causes compilation error with hbase
0.99, which is the first hbase version that supports hadoop 2 only.
> For this change will be permanent from hbase 1.0 and on, it would be better to be fixed.
> [^1]: https://issues.apache.org/jira/browse/HBASE-11805
> [^2]: https://issues.apache.org/jira/browse/HBASE-9359
> [^3]: https://issues.apache.org/jira/browse/HBASE-10526



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message