hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7371) Loading EC schemas from configuration
Date Thu, 06 Nov 2014 10:19:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200049#comment-14200049

Kai Zheng commented on HDFS-7371:

Configuring multiple erasure codecs (*JerasureRS*, *ISARS*, *ISALRC*) in *hdfs-site.xml* file:
    <name> hadoop.hdfs.ec.erasurecodec.codec.JerasureRS</name>
    <value> org.apache.hadoop.hdfs.ec.codec.JerasureRS </value>
    <name> hadoop.hdfs.ec.erasurecodec.codec.ISARS</name>
    <value> org.apache.hadoop.hdfs.ec.codec.IsaRS </value>
    <name> hadoop.hdfs.ec.erasurecodec.codec.ISALRC </name>
    <value> org.apache.hadoop.hdfs.ec.codec.IsaLRC </value>

And above configured codec can be referenced in the schemas defined in new configuration file
*HADOOP-CONF/ec-schema.xml*, like follows:
  <schema name="RSk6m3">
  <schema name="LRCk6l2r2">

> Loading EC schemas from configuration
> -------------------------------------
>                 Key: HDFS-7371
>                 URL: https://issues.apache.org/jira/browse/HDFS-7371
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Kai Zheng
>            Assignee: Kai Zheng
> System administrator can configure multiple EC codecs in hdfs-site.xml file, and codec
instances or schemas in a new configuration file named ec-schema.xml in the conf folder. A
codec can be referenced by its instance or schema using the codec name, and a schema can be
utilized and specified by the schema name for a folder to enforce EC.

This message was sent by Atlassian JIRA

View raw message