hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-925) Not able to run parallel instances of ant tests
Date Tue, 01 Sep 2009 03:47:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749747#action_12749747

Vinod K V commented on MAPREDUCE-925:

Most of the mapred tests write their temporary files to build.test.data which is set by the
build file to ${build-dir}/test/data. In that sense, though it is not hard-coded in the tests
themselves, it is kind of fixed.

Further many tests don't create _sub-directories_ inside ${build.test.data} directory, assume
that this directory itself is empty and create files directly under ${build.test.data}. Though
it is possible to fix this, it is huge task given the number of tests that need to be modified.
If it is really felt to be worth pursuing, we can open separate issues to fix tests one by

> Not able to run parallel instances of ant tests
> -----------------------------------------------
>                 Key: MAPREDUCE-925
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-925
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.1
>            Reporter: Suman Sehgal
>            Priority: Minor
> Not able to execute two or more parallel instances of ant test.
> Scenario:
> =======
> Executed  "TestRecoveryManager" in a loop for 100 times and ran some other tests in parallel.
Encountered following error message in TestRecoveryManager logs:
> [junit] 2009-08-27 10:53:48,724 INFO  mapred.TaskTracker (TaskTracker.java:tryToGetOutputSize(1594))
- org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/<job-id>/<attempt-id>/output/file.out
in any of the configured local directories
> It seems that new ant test removes the existing mapred local directory itself  and recreates
it for current test.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message