hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HADOOP-193) DFS i/o benchmark.
Date Thu, 10 Aug 2017 18:21:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Konstantin Shvachko reassigned HADOOP-193:
------------------------------------------

    Assignee: Konstantin Shvachko

> DFS i/o benchmark.
> ------------------
>
>                 Key: HADOOP-193
>                 URL: https://issues.apache.org/jira/browse/HADOOP-193
>             Project: Hadoop Common
>          Issue Type: Test
>          Components: fs
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>             Fix For: 0.2.0
>
>         Attachments: IOBenchmark.patch
>
>
> DFS i/o benchmark is a map-reduce based test that measures performance of the cluster
for reads and writes.
> This is an evolved version of HADOOP-72, and HADOOP-95 test.
> This test writes into or reads from a specified number of files.
> File size is specified as a parameter to the test.
> Each file is processed in a separate map task.
> The unique reducer then collects stats.
> Finally, the following information is displayed
> # read or write test
> # date and time the test finished
> # number of files processed
> # total number of bytes processed
> # throughput in mb/sec (total number of bytes / sum of processing times)
> # average i/o rate in mb/sec per file
> # standard i/o rate deviation
> I  included the test into the AllTestDriver.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message