Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F3AF918D2B for ; Thu, 24 Mar 2016 12:47:25 +0000 (UTC) Received: (qmail 23606 invoked by uid 500); 24 Mar 2016 12:47:25 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 23481 invoked by uid 500); 24 Mar 2016 12:47:25 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 23458 invoked by uid 99); 24 Mar 2016 12:47:25 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Mar 2016 12:47:25 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 7F5032C1F5D for ; Thu, 24 Mar 2016 12:47:25 +0000 (UTC) Date: Thu, 24 Mar 2016 12:47:25 +0000 (UTC) From: "Rui Li (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HADOOP-12924) Add default coder key for creating raw coders MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210167#comment-15210167 ] Rui Li commented on HADOOP-12924: --------------------------------- Based on my offline discussion with Kai, we have the following proposal: # We can consider HDFS-RAID and new Java coder as different codec, so that they'll map to different EC policies. Within each codec, we can have different implementations of raw coders which are interoperable. For HDFS-RAID codec, the legacy coder is the only implementation. For "other RS" codec (we can figure out a better name of course), we have the new Java coder and will probably have the ISA-L coder soon. # Each codec will have a dedicated raw coder configuration key, so that user can conveniently switch between different implementations. And switching raw coder doesn't require porting/re-encoding data, as long as the raw coders belong to the same codec. [~drankye] please add if I missed anything. [~zhz] what's your opinion about this? > Add default coder key for creating raw coders > --------------------------------------------- > > Key: HADOOP-12924 > URL: https://issues.apache.org/jira/browse/HADOOP-12924 > Project: Hadoop Common > Issue Type: Sub-task > Reporter: Rui Li > Assignee: Rui Li > Priority: Minor > Attachments: HADOOP-12924.1.patch > > > As suggested [here|https://issues.apache.org/jira/browse/HADOOP-12826?focusedCommentId=15194402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15194402]. -- This message was sent by Atlassian JIRA (v6.3.4#6332)