hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2004) Enable replicating and pinning files to a data node
Date Sat, 28 May 2011 21:34:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040678#comment-13040678

Todd Lipcon commented on HDFS-2004:

Note that this isn't likely to get committed to the 'append' branch unless it's committed
to trunk first. The idea of append was a stopgap so HBase would have something to use until
a later release is out. But it shouldn't be seen as a testing ground for new ideas.

bq. Unfortunately Lucene cannot work with non-local replicas

Let's separate "cannot work" from "cannot work as fast as it otherwise could".

If it indeed _cannot work_ without a local replica, then I agree with Allen/Eli - you should
just plan on copying the blocks you need over to a local tmp directory and people will take
the capacity hit.

> Enable replicating and pinning files to a data node
> ---------------------------------------------------
>                 Key: HDFS-2004
>                 URL: https://issues.apache.org/jira/browse/HDFS-2004
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer
>    Affects Versions: 0.23.0
>            Reporter: Jason Rutherglen
> Some HDFS applications require that a given file is on the local DataNode.  The functionality
created here will allow pinning the file to any DataNode.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message