hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bra...@apache.org
Subject [2/4] hadoop git commit: HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
Date Tue, 23 May 2017 16:05:01 GMT
HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.

(cherry picked from commit 52661e0912a79d1e851afc2b46c941ce952ca63f)


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d61418f3
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d61418f3
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/d61418f3

Branch: refs/heads/branch-2
Commit: d61418f34a6ed86c42c0d145c535d5b080399f21
Parents: ec346d6
Author: Brahma Reddy Battula <brahma@apache.org>
Authored: Tue May 23 23:52:42 2017 +0800
Committer: Brahma Reddy Battula <brahma@apache.org>
Committed: Tue May 23 23:53:27 2017 +0800

----------------------------------------------------------------------
 .../hadoop-common/src/site/markdown/Metrics.md       | 15 +++++++++++++++
 1 file changed, 15 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hadoop/blob/d61418f3/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
index 106b08d..3d1d3c4 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
@@ -284,6 +284,21 @@ Each metrics record contains tags such as SessionId and Hostname as additional
i
 | `WritesFromLocalClient` | Total number of write operations from local client |
 | `WritesFromRemoteClient` | Total number of write operations from remote client |
 | `BlocksGetLocalPathInfo` | Total number of operations to get local path names of blocks
|
+| `RamDiskBlocksWrite` | Total number of blocks written to memory |
+| `RamDiskBlocksWriteFallback` | Total number of blocks written to memory but not satisfied
(failed-over to disk) |
+| `RamDiskBytesWrite` | Total number of bytes written to memory |
+| `RamDiskBlocksReadHits` | Total number of times a block in memory was read |
+| `RamDiskBlocksEvicted` | Total number of blocks evicted in memory |
+| `RamDiskBlocksEvictedWithoutRead` | Total number of blocks evicted in memory without ever
being read from memory |
+| `RamDiskBlocksEvictionWindowMsNumOps` | Number of blocks evicted in memory|
+| `RamDiskBlocksEvictionWindowMsAvgTime` | Average time of blocks in memory before being
evicted in milliseconds |
+| `RamDiskBlocksEvictionWindows`*num*`s(50|75|90|95|99)thPercentileLatency` | The 50/75/90/95/99th
percentile of latency between memory write and eviction in milliseconds. Percentile measurement
is off by default, by watching no intervals. The intervals are specified by `dfs.metrics.percentiles.intervals`.
|
+| `RamDiskBlocksLazyPersisted` | Total number of blocks written to disk by lazy writer |
+| `RamDiskBlocksDeletedBeforeLazyPersisted` | Total number of blocks deleted by application
before being persisted to disk |
+| `RamDiskBytesLazyPersisted` | Total number of bytes written to disk by lazy writer |
+| `RamDiskBlocksLazyPersistWindowMsNumOps` | Number of blocks written to disk by lazy writer
|
+| `RamDiskBlocksLazyPersistWindowMsAvgTime` | Average time of blocks written to disk by lazy
writer in milliseconds |
+| `RamDiskBlocksLazyPersistWindows`*num*`s(50|75|90|95|99)thPercentileLatency` | The 50/75/90/95/99th
percentile of latency between memory write and disk persist in milliseconds. Percentile measurement
is off by default, by watching no intervals. The intervals are specified by `dfs.metrics.percentiles.intervals`.
|
 | `FsyncCount` | Total number of fsync |
 | `VolumeFailures` | Total number of volume failures occurred |
 | `ReadBlockOpNumOps` | Total number of read operations |


---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org


Mime
View raw message