hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-51) per-file replication counts
Date Thu, 23 Feb 2006 02:07:38 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-51?page=comments#action_12367456 ] 

Konstantin Shvachko commented on HADOOP-51:

I propose to add 2 functions.
1) An additional create() method that would take an extra parameter for that file replication.
This should be a new method in order to retain existing programs in working condition.
2) A new setReplication() method to be able to change replication for existing files.
It will also require an additional field in the INode class to store replication for each
on the namenode.

> per-file replication counts
> ---------------------------
>          Key: HADOOP-51
>          URL: http://issues.apache.org/jira/browse/HADOOP-51
>      Project: Hadoop
>         Type: New Feature
>   Components: dfs
>     Versions: 0.1
>     Reporter: Doug Cutting
>     Assignee: Konstantin Shvachko
>      Fix For: 0.1

> It should be possible to specify different replication counts for different files.  Perhaps
an option when creating a new file should be the desired replication count.  MapReduce should
take advantage of this feature so that job.xml and job.jar files, which are frequently accessed
by lots of machines, are more highly replicated than large data files.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message