hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2004) Enable replicating and pinning files to a data node
Date Fri, 27 May 2011 20:34:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040419#comment-13040419

Todd Lipcon commented on HDFS-2004:

To be clear, "pinning" isn't really what we want here. We want to *request* that the NN make
a local replica -- similar to what the balancer does.

All client software should *work* with non-local replicas, but if it knows it's going to need
a copy for a while, pulling one over makes some sense.

Yes, we could have HBase use some local storage to cache blocks, but then we're faced with
a potentially large increase in storage requirements.

> Enable replicating and pinning files to a data node
> ---------------------------------------------------
>                 Key: HDFS-2004
>                 URL: https://issues.apache.org/jira/browse/HDFS-2004
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer
>    Affects Versions: 0.23.0
>            Reporter: Jason Rutherglen
> Some HDFS applications require that a given file is on the local DataNode.  The functionality
created here will allow pinning the file to any DataNode.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message