hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Rutherglen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2004) Enable replicating and pinning files to a data node
Date Sat, 28 May 2011 23:24:48 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040695#comment-13040695

Jason Rutherglen commented on HDFS-2004:

{quote}If it indeed cannot work without a local replica, then I agree with Allen/Eli - you
should just plan on copying the blocks you need over to a local tmp directory and people will
take the capacity hit.{quote}

I think we may be a little out of scope for this issue.  The Lucene index isn't static, it'll
be updated somewhat frequently.  If we have a separate temp directory, there is a lot of room
for error, in addition to the natural redundancy.  As this is experimental/researchy I think
we can try the current system out, and if it doesn't work, examine other possibilities?

> Enable replicating and pinning files to a data node
> ---------------------------------------------------
>                 Key: HDFS-2004
>                 URL: https://issues.apache.org/jira/browse/HDFS-2004
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer
>    Affects Versions: 0.23.0
>            Reporter: Jason Rutherglen
> Some HDFS applications require that a given file is on the local DataNode.  The functionality
created here will allow pinning the file to any DataNode.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message