hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1641) Job submission should fail if same uri is added for mapred.cache.files and mapred.cache.archives
Date Mon, 29 Mar 2010 10:14:27 GMT
Job submission should fail if same uri is added for mapred.cache.files and mapred.cache.archives
------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1641
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1641
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: distributed-cache
            Reporter: Amareshwari Sriramadasu
             Fix For: 0.22.0


The behavior of mapred.cache.files and mapred.cache.archives is different during localization
in the following way:

If a jar file is added to mapred.cache.files,  it will be localized under TaskTracker under
a unique path. 
If a jar file is added to mapred.cache.archives, it will be localized under a unique path
in a directory named the jar file name, and will be unarchived under the same directory.

If same jar file is passed for both the configurations, the behavior undefined. Thus the job
submission should fail.
Currently, since distributed cache processes files before archives, the jar file will be just
localized and not unarchived.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message