hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1342) expose DFSOutputStream.getNumCurrentReplicas() in libhdfs
Date Mon, 16 Aug 2010 12:52:16 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898922#action_12898922
] 

dhruba borthakur commented on HDFS-1342:
----------------------------------------

There is a long running C-application (e.g. scribe) that writes to HDFS. The fact that HDFS
does not add new datanodes to replace failed datanodes in a live- pipeline means that we would
like to enhance the application to detect when a write pipeline is running on fewer replicas.
In this case, the app will close the file and start using a new HDFS file. This technique
is already used by HBase.

> expose DFSOutputStream.getNumCurrentReplicas() in libhdfs
> ---------------------------------------------------------
>
>                 Key: HDFS-1342
>                 URL: https://issues.apache.org/jira/browse/HDFS-1342
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: contrib/libhdfs
>            Reporter: sam rash
>            Assignee: sam rash
>            Priority: Minor
>
> DFSOutputStream exposes the number of writers in a pipeline.  We should make this callable
from libhdfs

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message