hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Krishna Ramachandran (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-2085) job submissions to a tracker using a different default filesystem than the jobclient fails
Date Mon, 27 Sep 2010 17:33:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Krishna Ramachandran updated MAPREDUCE-2085:
--------------------------------------------

    Attachment: mapred-3963156.patch

Suggested fix (for an earlier release) not for commit in trunk

With this simple change to jobClient were able to configure and use a non-default FileSystem
(viewFs)

https://issues.apache.org/jira/browse/HDFS-1053


> job submissions to a tracker using a different default filesystem than the jobclient
fails
> ------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2085
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2085
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Joydeep Sen Sarma
>            Priority: Minor
>         Attachments: mapred-3963156.patch
>
>
> the scenario is one where a jobclient with default filesystem 'A' tries to submit jobs
to a tracker whose system directory lives in filesystem 'B'.
> jobclient copies jars/archives to tracker's system directory. however - it does not use
the fully qualified uri's of the returned paths. this leads to failures subsequently in the
client because it attempts to dereference these paths against it's default file system (which
is different from the tracker's file system)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message