hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira AJISAKA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml
Date Wed, 02 Mar 2016 09:39:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15175339#comment-15175339
] 

Akira AJISAKA commented on HDFS-8356:
-------------------------------------

Reviewed from "dfs.client.retry.interval-ms.get-last-block-length" to "dfs.client.write.byte-array-manager.count-threshold".

1. In "dfs.client.retry.window.base", the wait time is extended linearly, not exponentially.
{code:title=DFSInputStream.java}
          // Introducing a random factor to the wait time before another retry.
          // The wait time is dependent on # of failures and a random factor.
          // At the first time of getting a BlockMissingException, the wait time
          // is a random number between 0..3000 ms. If the first retry
          // still fails, we will wait 3000 ms grace period before the 2nd retry.
          // Also at the second retry, the waiting window is expanded to 6000 ms
          // alleviating the request rate from the server. Similarly the 3rd retry
          // will wait 6000ms grace period before retry and the waiting window is
          // expanded to 9000ms.
{code}
In addition, would you add a time unit to the description?

2. "dfs.client.hedged.threadpool.size" should be "dfs.client.hedged.read.threadpool.size",
and "dfs.client.threshold.millis" should be "dfs.client.hedged.read.threshold.millis". (Please
see HDFS-9886 for the detail.)

> Document missing properties in hdfs-default.xml
> -----------------------------------------------
>
>                 Key: HDFS-8356
>                 URL: https://issues.apache.org/jira/browse/HDFS-8356
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: documentation
>    Affects Versions: 2.7.0
>            Reporter: Ray Chiang
>            Assignee: Ray Chiang
>              Labels: supportability, test
>         Attachments: HDFS-8356.001.patch, HDFS-8356.002.patch, HDFS-8356.003.patch, HDFS-8356.004.patch,
HDFS-8356.005.patch
>
>
> The following properties are currently not defined in hdfs-default.xml. These properties
should either be
> A) documented in hdfs-default.xml OR
> B) listed as an exception (with comments, e.g. for internal use) in the TestHdfsConfigFields
unit test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message