hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joshua Harlow (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-708) A stress-test tool for HDFS.
Date Fri, 30 Apr 2010 07:05:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12862567#action_12862567
] 

Joshua Harlow commented on HDFS-708:
------------------------------------

Attempt that using the following:

try {
      Block b = DFSTestUtil.getFirstBlock(fs, fn);
      blockId = b.getBlockId();
    } catch (IOException e) {
      LOG.warn("Failure to get first block info "
          + StringUtils.stringifyException(e));
    }

It seems though that an EOFException occurs if the file is empty even though it has been created.
"Failure to get first block info java.io.EOFException" and since this is needed to write the
first byte set then it will be needed before that write occurs.


> A stress-test tool for HDFS.
> ----------------------------
>
>                 Key: HDFS-708
>                 URL: https://issues.apache.org/jira/browse/HDFS-708
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: test, tools
>    Affects Versions: 0.22.0
>            Reporter: Konstantin Shvachko
>            Assignee: Joshua Harlow
>             Fix For: 0.22.0
>
>         Attachments: slive.patch, SLiveTest.pdf
>
>
> It would be good to have a tool for automatic stress testing HDFS, which would provide
IO-intensive load on HDFS cluster.
> The idea is to start the tool, let it run overnight, and then be able to analyze possible
failures.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message