hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13200) Seeking a better approach allowing to customize and configure erasure coders
Date Fri, 31 Mar 2017 05:38:41 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950354#comment-15950354
] 

Kai Zheng commented on HADOOP-13200:
------------------------------------

Hi Andrew,

Thanks for your thoughts! I guess I roughly catch your points, so try to align with yours:
1. How about for the raw coder factory registry we use {{ServiceLoader}} pattern? Say each
raw coder factory will be picked up from class loaders by the loader. All the loaded raw coder
factories will be populated into the singleton registry.

2. Assume each raw coder factory contributes to a codec, and the codec name can be determined
by {{RawCoderFactory->getCodecName()}}, so the mapping between codec and its implemented
raw coder factories can be determined while initialization phase. 

3. Considering a codec can have multiple raw coder factories and users may want to specify
the priority list, how about each raw coder or its factory is assigned a unique name? The
name can be determined by {{RawCoderFactory->getName()}}. The name can be used in the priority
list.

> Seeking a better approach allowing to customize and configure erasure coders
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-13200
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13200
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Kai Zheng
>            Assignee: Kai Zheng
>            Priority: Blocker
>              Labels: hdfs-ec-3.0-must-do
>
> This is a follow-on task for HADOOP-13010 as discussed over there. There may be some
better approach allowing to customize and configure erasure coders than the current having
raw coder factory, as [~cmccabe] suggested. Will copy the relevant comments here to continue
the discussion.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message