hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6248) Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
Date Fri, 11 Sep 2009 23:23:57 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12754416#action_12754416

Owen O'Malley commented on HADOOP-6248:

This is not ready to commit. It may be useful at somepoint, but there is currently no value
there. It is hard to evaluate what you are trying to accomplish, since this is just an empty
shell. There needs to be substantial added value over the current distribution to be worth
including a patch in our code base.

Please review the MiniMRCluster and MiniHDFSCluster. We already have a lot of system tests.

It would actually be more useful to have a mock object framework to support real unit tests...

I'd suggest making less ambitious goals. A smoke test script that submits some of the examples
might make sense, but it would just look like:
* Write a file to hdfs
* Run some of the examples from the examples jar (wordcount, rand-writer, sort, sort-validation)
* Remove files

But it has nothing to do with system testing, just a light smoke test.

It certainly shouldn't be doing downloads or installs. That is just overkill.

On the other hand, it would be nice to have a patch to build.xml to generate RPMs (HADOOP-6255).

> Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
> ---------------------------------------------------------------------------
>                 Key: HADOOP-6248
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6248
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: test
>         Environment: Python, bash
>            Reporter: Alex Loddengaard
>         Attachments: HADOOP-6248.diff, HADOOP-6248_v2.diff, HADOOP-6248_v3.diff
> This issue contains a proposal and preliminary source code for Circus, a Hadoop system
testing framework.  At a high level, Circus will help Hadoop users and QA engineers to run
system tests on a configurable Hadoop cluster, or distribution of Hadoop.  See the comment
below for the proposal itself.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message