crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <>
Subject [jira] [Commented] (CRUNCH-475) Compilation problem caused by KeyValue -> Cell conversion
Date Tue, 14 Oct 2014 02:54:34 GMT


Micah Whitacre commented on CRUNCH-475:

However, dislike to KeyValue, there is no concrete state to be serialized / deserialized.
I don't know how to replace HBaseTypes#bytesToKeyValue and HBaseTypes#keyValueToBytes.

May I assume that the Cell object in WritableType<Cell> is actually KeyValue object?

In the patch I found that I had to revert Cell back to using the KeyValue Writable methods
for serialization because that type is used for reading payloads out of an HFile.  Using the
ProtobufUtil/ClientProtos.Cell classes will probably be what we use for serialization in later
versions of HBase but we'd need the HFile format to change before we could make that change.

> Compilation problem caused by KeyValue -> Cell conversion
> ---------------------------------------------------------
>                 Key: CRUNCH-475
>                 URL:
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.12.0
>            Reporter: Lee Dongjin
>            Assignee: Josh Wills
>            Priority: Minor
>         Attachments: CRUNCH-475.patch
> From hbase 0.99, Using KeyValue class for hbase I/O is deprecated and in many APIs it
was replaced with Cell interface[^1][^2][^3]. This change causes compilation error with hbase
0.99, which is the first hbase version that supports hadoop 2 only.
> For this change will be permanent from hbase 1.0 and on, it would be better to be fixed.
> [^1]:
> [^2]:
> [^3]:

This message was sent by Atlassian JIRA

View raw message