hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Boudnik (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-925) Not able to run parallel instances of ant tests
Date Mon, 31 Aug 2009 18:55:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749576#action_12749576

Konstantin Boudnik commented on MAPREDUCE-925:

bq. The test suite was never intended to be running parallel tests as most of the test share
the same temporary space

Are you saying that tests have hardcoded paths for temp. output, etc.? It doesn't seem like
a very flexible way of making 'portable' tests which can be executed on different platforms
with, potentially, different temp. location mounts. I think the rule of thumb is not to let
tests to step on each other feet in terms of temp. data files, output and all that. 

> Not able to run parallel instances of ant tests
> -----------------------------------------------
>                 Key: MAPREDUCE-925
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-925
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.1
>            Reporter: Suman Sehgal
>            Priority: Minor
> Not able to execute two or more parallel instances of ant test.
> Scenario:
> =======
> Executed  "TestRecoveryManager" in a loop for 100 times and ran some other tests in parallel.
Encountered following error message in TestRecoveryManager logs:
> [junit] 2009-08-27 10:53:48,724 INFO  mapred.TaskTracker (TaskTracker.java:tryToGetOutputSize(1594))
- org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/<job-id>/<attempt-id>/output/file.out
in any of the configured local directories
> It seems that new ant test removes the existing mapred local directory itself  and recreates
it for current test.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message