hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-11961) Add isLinear interface to Erasure coder
Date Tue, 12 May 2015 07:16:00 GMT
Yi Liu created HADOOP-11961:
-------------------------------

             Summary: Add isLinear interface to Erasure coder
                 Key: HADOOP-11961
                 URL: https://issues.apache.org/jira/browse/HADOOP-11961
             Project: Hadoop Common
          Issue Type: Sub-task
            Reporter: Yi Liu
            Assignee: Yi Liu


Today, we have a discussion including [~zhz], [~drankye], etc., also discuss in HDFS-8347.
Some coder like {{RS}} and {{XOR}} is linear, some have coding boundary like HitchHicker.
 If the coder is linear, we can decode at any size, and we don't need to padding inputs to
*chunksize*,  if the coder is not linear, the inputs need to padding to *chunksize*, then
do decode.

This interface is important for performance, and can save memory/disk space since the parity
cells are the same as first data cell (less than codec chunksize).  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message