hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-752) DistributedCache.addArchiveToClassPath doesn't work
Date Mon, 31 Aug 2009 04:57:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749378#action_12749378
] 

Vinod K V commented on MAPREDUCE-752:
-------------------------------------

On trunk, DistributedCache related code in TaskRunner was moved to TaskDistributedCacheManager
via MAPREDUCE-476 and was aggressively refactored. I am not very sure whether the bug you
are pointing here exists any longer or not. Can you please check?

> DistributedCache.addArchiveToClassPath doesn't work
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-752
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-752
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.1, 0.21.0
>            Reporter: Vladimir Klimontovich
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-752-ver2.patch, MAPREDUCE-752-ver3.patch, MAPREDUCE-752.patch,
MAPREDUCE-752.zip
>
>
> addArchiveToClassPath is a method of DistributedCache class. It should be called before
running a task. It accepts path to a jar file on a DFS. After it
> this method should put this jar file on sitribuuted cache and than add this file to classpath
to each map/reduce process on job tracker. 
> This method don't work:
> in TaskRunner there is an algorithm that looks for correspondence between DFS paths and
local paths in distributed cache.
> It compares
> if (archives[i].getPath().equals(
> archiveClasspaths[j].toString())){
> instead of
> if (archives[i].toString().equals(
> archiveClasspaths[j].toString())) 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message