Mailing-List: contact crunch-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: crunch-dev@incubator.apache.org
Date: Tue, 14 Aug 2012 04:32:38 +1100 (NCT)
From: "Gabriel Reid (JIRA)" <jira@apache.org>
To: crunch-dev@incubator.apache.org
Message-ID: <184395511.2800.1344879158300.JavaMail.jiratomcat@arcas>
Subject: [jira] [Commented] (CRUNCH-42) Improve speed of running integration
 tests
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CRUNCH-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433339#comment-13433339 ] 

Gabriel Reid commented on CRUNCH-42:
------------------------------------

I don't seem to be getting the performance improvement that I was getting on this before I cleaned up the patch -- I'm going to look into it a bit further before I push to the repo.
                
> Improve speed of running integration tests
> ------------------------------------------
>
>                 Key: CRUNCH-42
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-42
>             Project: Crunch
>          Issue Type: Improvement
>    Affects Versions: 0.3.0
>            Reporter: Gabriel Reid
>            Assignee: Gabriel Reid
>            Priority: Minor
>         Attachments: 0001-Use-short-job-poll-interval-when-in-local-mode.patch
>
>
> The CrunchJobControl currently uses a hard-coded poll interval of 5 seconds to check on running jobs. This is valid when running jobs on large datasets on a cluster, but results in unnecessary waiting when running in local mode. By using a smaller poll interval when running in local mode, the performance of the integration tests can be greatly improved.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira