hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels
Date Fri, 10 Nov 2017 03:32:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246971#comment-16246971
] 

Hudson commented on HDFS-12791:
-------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13217 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/13217/])
HDFS-12791. NameNode Fsck http Connection can timeout for directories (cliang: rev 10a1f557e775e7a55958b106dd10021ac7394843)
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java


> NameNode Fsck http Connection can timeout for directories with multiple levels
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-12791
>                 URL: https://issues.apache.org/jira/browse/HDFS-12791
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: tools
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>         Attachments: HDFS-12791.001.patch
>
>
> Currently the http connections are flushed for every 100 files, however if there are
multiple levels of directories in the namespace then flushing will be postponed till multiple
directories levels have been traversed. This connection timeout can be avoided if both files
and directories are considered for the flushing query.
> {code}
>     if (showprogress && (replRes.totalFiles + ecRes.totalFiles) % 100 == 0) {
>       out.println();
>       out.flush();
>     }
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message