hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-708) A stress-test tool for HDFS.
Date Thu, 29 Apr 2010 17:56:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12862287#action_12862287
] 

Konstantin Shvachko commented on HDFS-708:
------------------------------------------

Sorry, (4) was a bit vague. I meant that the start and end times should be taken right around
the actual HDFS action. E.g. for write it would be
{code}
get_start_time;
outputStream.write();
get_elapsed_time;
{code}

15. Forgot to mention that SLive should have a test. It can be simple. It can call slive on
local MR and local FS with some reasonable parameters, which trigger most of the code paths.
An alternative is to start Mini clusters and run slive on them. The important thing is it
should not take long time to run.

> A stress-test tool for HDFS.
> ----------------------------
>
>                 Key: HDFS-708
>                 URL: https://issues.apache.org/jira/browse/HDFS-708
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: test, tools
>    Affects Versions: 0.22.0
>            Reporter: Konstantin Shvachko
>            Assignee: Joshua Harlow
>             Fix For: 0.22.0
>
>         Attachments: slive.patch, SLiveTest.pdf
>
>
> It would be good to have a tool for automatic stress testing HDFS, which would provide
IO-intensive load on HDFS cluster.
> The idea is to start the tool, let it run overnight, and then be able to analyze possible
failures.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message