hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels
Date Fri, 10 Nov 2017 02:42:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246944#comment-16246944
] 

Chen Liang commented on HDFS-12791:
-----------------------------------

Thanks for working on this [~msingh]! +1 on v001 patch, the failed tests all passed in my
local run. Will commit this shortly.

> NameNode Fsck http Connection can timeout for directories with multiple levels
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-12791
>                 URL: https://issues.apache.org/jira/browse/HDFS-12791
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: tools
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>         Attachments: HDFS-12791.001.patch
>
>
> Currently the http connections are flushed for every 100 files, however if there are
multiple levels of directories in the namespace then flushing will be postponed till multiple
directories levels have been traversed. This connection timeout can be avoided if both files
and directories are considered for the flushing query.
> {code}
>     if (showprogress && (replRes.totalFiles + ecRes.totalFiles) % 100 == 0) {
>       out.println();
>       out.flush();
>     }
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message