hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1295) We need a job trace manipulator to build gridmix runs.
Date Tue, 22 Dec 2009 06:09:18 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793523#action_12793523

Hadoop QA commented on MAPREDUCE-1295:

-1 overall.  Here are the results of testing the latest attachment 
  against trunk revision 893055.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 6 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The applied patch generated 2331 javac compiler warnings (more than the trunk's
current 2330 warnings).

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit

    -1 core tests.  The patch failed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/330/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/330/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/330/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/330/console

This message is automatically generated.

> We need a job trace manipulator to build gridmix runs.
> ------------------------------------------------------
>                 Key: MAPREDUCE-1295
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1295
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Dick King
>            Assignee: Dick King
>         Attachments: mapreduce-1295--2009-12-17.patch, mapreduce-1295--2009-12-21.patch,
> Rumen produces "job traces", which are JSON format files describing important aspects
of all jobs that are run [successfully or not] on a hadoop map/reduce cluster.  There are
two packages under development that will consume these trace files and produce actions in
that cluster or another cluster: gridmix3 [see jira MAPREDUCE-1124 ] and Mumak [a simulator
-- see MAPREDUCE-728 ].
> It would be useful to be able to do two things with job traces, so we can run experiments
using these two tools: change the duration, and change the density.  I would like to provide
a "folder", a tool that can wrap a long-duration execution trace to redistribute its jobs
over a shorter interval, and also change the density by duplicating or culling away jobs from
the folded combined job trace.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message