hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dick King (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1745) FileInputFormat.setInputPaths() has sideffects on the passed conf besides setting the input.dir path
Date Thu, 29 Apr 2010 22:45:54 GMT
FileInputFormat.setInputPaths() has sideffects on the passed conf besides setting the input.dir
path
----------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1745
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1745
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: Dick King


it sets other props, like {{mapred.working.dir}} , it sets this using the current user (which
may be the superuser), then
the job submission for a proxy user fails because the {{mapred.working.dir}} is not the right
one for the proxy user.

This is observed when using relative directories, they are resolved to the homeDir of the
superuser instead of the
proxy user.

I did not check, but I suspect the {{FileOutputForamt.setOutputPath()}} may have similar side
effects

There is a workaround, setting up the {{mapred.input.dir}} and {{mapred.output.dir}} directly
by hand in the conf instead using
the methods above

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message