hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Graham (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2477) MR client uses fs.default.name as provided from the JobTracker instead of local value
Date Thu, 05 May 2011 23:01:03 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029640#comment-13029640
] 

Bill Graham commented on MAPREDUCE-2477:
----------------------------------------

Moved from Pig JIRA to MapReduce.

> MR client uses fs.default.name as provided from the JobTracker instead of local value
> -------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2477
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2477
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Bill Graham
>         Attachments: pig_1304465896181.log
>
>
> Initially opened against Pig, but this seems to be a MR bug. 
> When submitting a [MapReduce] job, the client uses the {{fs.default.name}} supplied to
it by the JobTracker (via core-site.xml on the master typically) during the staging phase.
After that, the client then uses the {{fs.default.name}} from it's local configs. This seems
like a bug to me. Expected behavior would be to always use the local value.
> I found this bug when the server configs were set to not use a FQDN for {{fs.default.name}}.
This caused the client to fail because it didn't have the same default DNS domain. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message