hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1522) FileInputFormat may change the file system of an input path
Date Sat, 06 Mar 2010 16:49:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12842274#action_12842274
] 

Hudson commented on MAPREDUCE-1522:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #250 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/250/])
    . FileInputFormat may use the default FileSystem for the
input path. Contributed by Tsz Wo (Nicholas), SZE


> FileInputFormat may change the file system of an input path
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-1522
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1522
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: M1522-1.patch, M1522-1v20.patch, M1522-1v21.patch, m1522_20100224.patch,
m1522_20100224_0.20.patch, m1522_20100301.patch, m1522_20100301_0.20.patch, m1522_20100301_0.21.patch,
m1552_20100223_0.20.patch
>
>
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(Job job, Path path)
uses the default FileSystem but not the FileSystem specified in the path.
> {code}
> //org.apache.hadoop.mapreduce.lib.input.FileInputFormat
>   public static void addInputPath(Job job, 
>                                   Path path) throws IOException {
>     Configuration conf = job.getConfiguration();
>     FileSystem fs = FileSystem.get(conf);
>     path = path.makeQualified(fs); // the original FileSystem is lost.
>     ...
>   }
> {code}
> There is a similar problem in FileInputFormat.setInputPaths(..).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message