Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <1819049944.107401267827207295.JavaMail.jira@brutus.apache.org>
Date: Fri, 5 Mar 2010 22:13:27 +0000 (UTC)
From: "Chris Douglas (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Commented: (MAPREDUCE-1522) FileInputFormat may change the
 file system of an input path
In-Reply-To: <502228246.444721266876027910.JavaMail.jira@brutus.apache.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12842060#action_12842060 ] 

Chris Douglas commented on MAPREDUCE-1522:
------------------------------------------

All test failures are due to Hudson's recent abject uselessness:
{noformat}
java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:169)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
{noformat}

The former test results hold, as:
# The original run failed only {{TestMRLocalFS}} due to MAPREDUCE-1520
# The only changes are in the unit test, which passes

> FileInputFormat may change the file system of an input path
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-1522
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1522
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: M1522-1.patch, M1522-1v20.patch, M1522-1v21.patch, m1522_20100224.patch, m1522_20100224_0.20.patch, m1522_20100301.patch, m1522_20100301_0.20.patch, m1522_20100301_0.21.patch, m1552_20100223_0.20.patch
>
>
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(Job job, Path path) uses the default FileSystem but not the FileSystem specified in the path.
> {code}
> //org.apache.hadoop.mapreduce.lib.input.FileInputFormat
>   public static void addInputPath(Job job, 
>                                   Path path) throws IOException {
>     Configuration conf = job.getConfiguration();
>     FileSystem fs = FileSystem.get(conf);
>     path = path.makeQualified(fs); // the original FileSystem is lost.
>     ...
>   }
> {code}
> There is a similar problem in FileInputFormat.setInputPaths(..).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.