hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5157) Sort in hadoop-1 examples is not binary compatible with hadoop-2 mapred.lib
Date Wed, 17 Apr 2013 16:49:16 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13634193#comment-13634193
] 

Zhijie Shen commented on MAPREDUCE-5157:
----------------------------------------

Bellow is the log I observed when executing hadoop-2.0.4-alpha/bin/hadoop jar hadoop-1.1.1/hadoop-examples-1.1.1.jar

{code}
java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/lib/InputSampler$Sampler
	at java.lang.Class.getDeclaredMethods0(Native Method)
	at java.lang.Class.privateGetDeclaredMethods(Class.java:2436)
	at java.lang.Class.getMethod0(Class.java:2679)
	at java.lang.Class.getMethod(Class.java:1605)
	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.<init>(ProgramDriver.java:60)
	at org.apache.hadoop.util.ProgramDriver.addClass(ProgramDriver.java:103)
	at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:50)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.lib.InputSampler$Sampler
	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
	... 12 more
{code}
                
> Sort in hadoop-1 examples is not binary compatible with hadoop-2 mapred.lib
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5157
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>
> In SORT example, org.apache.hadoop.mapred.lib.InputSampler.Sampler is used in hadoop-1.
However, after upgrading to hadoop-2, org.apache.hadoop.mapred.lib.InputSampler is modified
to extend org.apache.hadoop.mapreduce.lib.partition.InputSampler, and the inner class, Sampler,
has been moved to the superclass. Therefore, hadoop-1 SORT can not find Sampler when it runs
with hadoop-2 framework.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message