hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-3085) Local data node may need to reconsider for read, when reading a very big file as that local DN may get recover in some time.
Date Tue, 13 Mar 2012 18:34:42 GMT

     [ https://issues.apache.org/jira/browse/HDFS-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Uma Maheswara Rao G updated HDFS-3085:
--------------------------------------

    Summary: Local data node may need to reconsider for read, when reading a very big file
as that local DN may get recover in some time.  (was: Local data node may need to reconsider
for read, while reading a very big file as it may get recover in some time.)
    
> Local data node may need to reconsider for read, when reading a very big file as that
local DN may get recover in some time.
> ----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-3085
>                 URL: https://issues.apache.org/jira/browse/HDFS-3085
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: data-node, hdfs client
>    Affects Versions: 0.24.0
>            Reporter: Uma Maheswara Rao G
>
> While reading the file, we will add the DN to deadNodes list and will skip from reads.
> If we are reading very huge file (may take hours), and failed read from local datanode,
then this will be added to deadnode list and will be excluded for the further reads for that
file.
> If the local node recovered immediately,but that will not used for further read. Read
may continue with the remote nodes. It will effect the read performance.
> It will be good if we reconsider the local node after certain period based on some factors.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message