hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ruyue Ma (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4764) add replication factor for hdfs directory
Date Thu, 04 Dec 2008 04:23:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653153#action_12653153
] 

Ruyue Ma commented on HADOOP-4764:
----------------------------------

Hi, Konstantin Shvachko

Current trunk version has implemented what you said.

But it is different from my point. You know the default replication factor for file in hadoop-default.xml
is 3. few people will modify it. And if i (as a hadoop administrator) want to change the default
value, want to limit some file replication factor in some directory to 2. I don't know how
to do now. Current hadoop can't support it.

If i can set replication factor for directory, the file's default replication factor will
inherite its parent dir's factor. I can give different dir different default replication factor.

Yes it is a big patch. it will modify the image format. But it can be compatible with old
format. 

Please forgive me for my poor English!

Thanks

> add replication factor for hdfs directory
> -----------------------------------------
>
>                 Key: HADOOP-4764
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4764
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: Ruyue Ma
>
> If we can set replication factor for directory. we can modify the DFSClent.create() method,
pass 0 for the default block replication. Namenode check create request, if blockreplication
is 0, it will give its parent dir replication factor to the file blockreplication factor.
This will simplify the administration work. You know we can set /Test or /Tmp dir's replication
factor 2 or 1, then all their children files and dirs replication factor is 2 or 1 defaultly.
>    

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message