hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2004) Enable replicating and pinning files to a data node
Date Mon, 06 Jun 2011 03:17:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044688#comment-13044688
] 

Allen Wittenauer commented on HDFS-2004:
----------------------------------------

I'm vetoing the very concept of a client being able to dictate to the NN how it should replicate
the data.  It won't scale up very well without having severe performance consequences to the
NN.

It should also be pointed out that the HBASE example is essentially bypassing HDFS to talk
directly to the underlying file system via mmap(). We should not encourage such bad behavior.

> Enable replicating and pinning files to a data node
> ---------------------------------------------------
>
>                 Key: HDFS-2004
>                 URL: https://issues.apache.org/jira/browse/HDFS-2004
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer
>    Affects Versions: 0.23.0
>            Reporter: Jason Rutherglen
>
> Some HDFS applications require that a given file is on the local DataNode.  The functionality
created here will allow pinning the file to any DataNode.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message