hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-967) TaskTracker does not need to fully unjar job jars
Date Thu, 10 Sep 2009 06:26:58 GMT
TaskTracker does not need to fully unjar job jars

                 Key: MAPREDUCE-967
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-967
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: tasktracker
    Affects Versions: 0.21.0
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon

In practice we have seen some users submitting job jars that consist of 10,000+ classes. Unpacking
these jars into mapred.local.dir and then cleaning up after them has a significant cost (both
in wall clock and in unnecessary heavy disk utilization). This cost can be easily avoided

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message