hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-825) JobClient completion poll interval of 5s causes slow tests in local mode
Date Fri, 07 Aug 2009 20:57:14 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740726#action_12740726

Hadoop QA commented on MAPREDUCE-825:

-1 overall.  Here are the results of testing the latest attachment 
  against trunk revision 801959.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit

    +1 core tests.  The patch passed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/454/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/454/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/454/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/454/console

This message is automatically generated.

> JobClient completion poll interval of 5s causes slow tests in local mode
> ------------------------------------------------------------------------
>                 Key: MAPREDUCE-825
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-825
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>            Priority: Minor
>         Attachments: completion-poll-interval.patch, MAPREDUCE-825.2.patch
> The JobClient.NetworkedJob.waitForCompletion() method polls for job completion every
5 seconds. When running a set of short tests in pseudo-distributed mode, this is unnecessarily
slow and causes lots of wasted time. When bandwidth is not scarce, setting the poll interval
to 100 ms results in a 4x speedup in some tests.  This interval should be parametrized to
allow users to control the interval for testing purposes.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message