hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1635) ResourceEstimator does not work after MAPREDUCE-842
Date Mon, 29 Mar 2010 09:32:27 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amareshwari Sriramadasu updated MAPREDUCE-1635:
-----------------------------------------------

    Description: 
MAPREDUCE-842 changed Child's mapred.local.dir to have attemptDir as the base local directory.
Also assumption is that
org.apache.hadoop.mapred.MapOutputFile always gets Child's mapred.local.dir. 
But, MapOuptutFile.getOutputFile() is called from TaskTracker's conf, which does not find
the output file. Thus TaskTracker.tryToGetOutputSize() always returns -1.


  was:
MAPREDUCE-842 changed Child's mapred.local.dir to have attemptDir as the base local directory.
Also assumption is that
org.apache.hadoop.mapred.MapOutputFile always gets Child's mapred.local.dir. 
But, MapOuptutFile.getOutputFile() is called from TaskTracker's conf, which does not find
the output file. Thus TaskTracker.tryToGetOutputSize() always returns zero.



> ResourceEstimator does not work after MAPREDUCE-842
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-1635
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1635
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.22.0
>
>         Attachments: patch-1635.txt
>
>
> MAPREDUCE-842 changed Child's mapred.local.dir to have attemptDir as the base local directory.
Also assumption is that
> org.apache.hadoop.mapred.MapOutputFile always gets Child's mapred.local.dir. 
> But, MapOuptutFile.getOutputFile() is called from TaskTracker's conf, which does not
find the output file. Thus TaskTracker.tryToGetOutputSize() always returns -1.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message