hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Loddengaard (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6248) Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
Date Fri, 25 Sep 2009 05:41:16 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759386#action_12759386
] 

Alex Loddengaard commented on HADOOP-6248:
------------------------------------------

Thanks for the feedback, Chris.  I think we're having a Buddhism vs. Christianity argument.
 Read: I think the two of us have different expectations for a tool like this, and perhaps
we'll never agree.  You want a strict framework and find an "execution engine" to be uninteresting
for the Hadoop distribution.  I think this tool doubles as a system testing tool that we as
a community can contribute tests to (you even said that distcp tests at scale are manual;
they don't have to be), in addition to an execution engine that Hadoop users can take advantage
of for reasons I've already stated.  I'm also unsure how a "scaled back" system would be any
more interesting or useful.  Perhaps you could provide some suggestions on how I might scale
this back, and how such a scaled back version would be handy?

I can tell you that Circus will be useful within Cloudera, and it will be useful for several
of our support customers.  I think I've done all I can to prove its merit, so perhaps others
can weigh in on whether or not such a framework, execution engine, or what have you would
be useful for them.  Lastly, I would hope that contrib projects (such as Circus) would be
more easily accepted into the distribution, as they don't negatively impact the project at
all.  Their "optional" nature allows users who are interested to use contrib projects at will,
while not dirtying or making any other real sacrifices to the rest of the code base.

In summary, Chris, can you provide specific guidance on how I might scale back Circus to be
something more useful?  Others, could you please comment on whether or not Circus would be
useful to you, and at least provide some guidance for how I can make it better?

Thanks again for your feedback, Chris.

> Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
> ---------------------------------------------------------------------------
>
>                 Key: HADOOP-6248
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6248
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: test
>         Environment: Python, bash
>            Reporter: Alex Loddengaard
>         Attachments: HADOOP-6248.diff, HADOOP-6248_v2.diff, HADOOP-6248_v3.diff
>
>
> This issue contains a proposal and preliminary source code for Circus, a Hadoop system
testing framework.  At a high level, Circus will help Hadoop users and QA engineers to run
system tests on a configurable Hadoop cluster, or distribution of Hadoop.  See the comment
below for the proposal itself.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message