hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12924) Add default coder key for creating raw coders
Date Thu, 24 Mar 2016 12:47:25 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210167#comment-15210167
] 

Rui Li commented on HADOOP-12924:
---------------------------------

Based on my offline discussion with Kai, we have the following proposal:
# We can consider HDFS-RAID and new Java coder as different codec, so that they'll map to
different EC policies. Within each codec, we can have different implementations of raw coders
which are interoperable. For HDFS-RAID codec, the legacy coder is the only implementation.
For "other RS" codec (we can figure out a better name of course), we have the new Java coder
and will probably have the ISA-L coder soon.
# Each codec will have a dedicated raw coder configuration key, so that user can conveniently
switch between different implementations. And switching raw coder doesn't require porting/re-encoding
data, as long as the raw coders belong to the same codec.

[~drankye] please add if I missed anything.
[~zhz] what's your opinion about this?

> Add default coder key for creating raw coders
> ---------------------------------------------
>
>                 Key: HADOOP-12924
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12924
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Minor
>         Attachments: HADOOP-12924.1.patch
>
>
> As suggested [here|https://issues.apache.org/jira/browse/HADOOP-12826?focusedCommentId=15194402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15194402].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message