hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Walter Su (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8390) merge BlockPlacementPolicyWithNodeGroup with default policy
Date Thu, 14 May 2015 12:41:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Walter Su updated HDFS-8390:
----------------------------
    Description: 
We saw requirements for adding new policies.( HDFS-7613, HDFS-7892, HDFS-8131, maybe  HDFS-4894,
HDFS-7068 in the future). Every policy need to support NodeGroup.

Assume we have N policies:
{noformat}
BlockPlacementPolicyDefault
BlockPlacementPolicyCustomized1 extends BlockPlacementPolicyDefault
BlockPlacementPolicyCustomized2 extends BlockPlacementPolicyDefault
BlockPlacementPolicyCustomized3 extends BlockPlacementPolicyDefault
{noformat}
We need to implements another N policies:
{noformat}
BlockPlacementPolicyyWithNodeGroup
BlockPlacementPolicyCustomized1WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
BlockPlacementPolicyCustomized2WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
BlockPlacementPolicyCustomized3WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
{noformat}
We had better merge nodeGroup awareness into default policy. So every new policy only need
to extends BlockPlacementPolicyDefault.

  was:
We saw requirements for adding new policies.( HDFS-7613, HDFS-7892, maybe  HDFS-4894, HDFS-7068
in the future). Every policy need to support NodeGroup.

Assume we have N policies:
{noformat}
BlockPlacementPolicyDefault
BlockPlacementPolicyCustomized1 extends BlockPlacementPolicyDefault
BlockPlacementPolicyCustomized2 extends BlockPlacementPolicyDefault
BlockPlacementPolicyCustomized3 extends BlockPlacementPolicyDefault
{noformat}
We need to implements another N policies:
{noformat}
BlockPlacementPolicyyWithNodeGroup
BlockPlacementPolicyCustomized1WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
BlockPlacementPolicyCustomized2WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
BlockPlacementPolicyCustomized3WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
{noformat}
We had better merge nodeGroup awareness into default policy. So every new policy only need
to extends BlockPlacementPolicyDefault.


> merge BlockPlacementPolicyWithNodeGroup with default policy
> -----------------------------------------------------------
>
>                 Key: HDFS-8390
>                 URL: https://issues.apache.org/jira/browse/HDFS-8390
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Walter Su
>            Assignee: Walter Su
>         Attachments: HDFS-8390.001.patch, HDFS-8390.002.patch, HDFS-8390.003.patch
>
>
> We saw requirements for adding new policies.( HDFS-7613, HDFS-7892, HDFS-8131, maybe
 HDFS-4894, HDFS-7068 in the future). Every policy need to support NodeGroup.
> Assume we have N policies:
> {noformat}
> BlockPlacementPolicyDefault
> BlockPlacementPolicyCustomized1 extends BlockPlacementPolicyDefault
> BlockPlacementPolicyCustomized2 extends BlockPlacementPolicyDefault
> BlockPlacementPolicyCustomized3 extends BlockPlacementPolicyDefault
> {noformat}
> We need to implements another N policies:
> {noformat}
> BlockPlacementPolicyyWithNodeGroup
> BlockPlacementPolicyCustomized1WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
> BlockPlacementPolicyCustomized2WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
> BlockPlacementPolicyCustomized3WithNodeGroup extends BlockPlacementPolicyWithNodeGroup
> {noformat}
> We had better merge nodeGroup awareness into default policy. So every new policy only
need to extends BlockPlacementPolicyDefault.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message