hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Randy Clayton (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4234) SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name)
Date Tue, 08 May 2012 20:35:49 GMT
Randy Clayton created MAPREDUCE-4234:
----------------------------------------

             Summary: SortValidator.java is incompatible with multi-user or parallel use (due
to a /tmp file with static name)
                 Key: MAPREDUCE-4234
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4234
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: examples
    Affects Versions: 0.23.3
            Reporter: Randy Clayton
            Priority: Minor


The SortValidator.java file checkRecords method creates a file in the /tmp/sortvalidator directory
using a static filename. This can result in failures due to name collisions when the hadoop-mapreduce-client-jobclient-*-tests
jar is used by more than one task or one user simultaneously. We use this jar when testing
compression codecs and after we started running tests in parallel (four at a time to reduce
overall test time) we started experiencing random test failures due to name collisions. Creating
a random or unique per thread filename may resolve this issue. We have developed a change
to introduce per use unique file names. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message