hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2121) Add ability to create block replicas during off-switch reads
Date Thu, 18 Aug 2011 06:49:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13086837#comment-13086837
] 

Koji Noguchi commented on HDFS-2121:
------------------------------------

Besides from performance, not sure how dfsclient/reader can be involved in replicating the
data without risking security.  (or are we saying data is replicated to the local datanode
first and dfsclient reading out of that?)

> Add ability to create block replicas during off-switch reads
> ------------------------------------------------------------
>
>                 Key: HDFS-2121
>                 URL: https://issues.apache.org/jira/browse/HDFS-2121
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Arun C Murthy
>
> Idea: when a DFSClient reads an off-switch replica, we could tee an extra, temporal replica
to the local DN if the NN thinks it makes sense. 
> Then we could delete the ones which were part of the original 2 on the rack to rebalance
or just rely on the balancer... all this would ensure better spread across the cluster. This
would also help with hotspots on datasets.
> Thoughts?

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message