hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Stack <st...@archive.org>
Subject FYI: JVM1.6.0 issue: Re: [jira] Updated: (HADOOP-189) Add job jar lib, classes, etc. to CLASSPATH when in standalone mode
Date Thu, 04 May 2006 01:52:34 GMT
FYI, the final commit on HADOOP-189 was failing for me in really weird 
ways.  Compiling hadoop with 1.6.0beta2 looks to be the culprit.

Just starting up daemons in pseudo-distributed mode, usually NameNode 
and TaskTracker would fail with exceptions like the following:

060503 180738 12 Client connection to 127.0.0.1:9000 caught: 
java.lang.RuntimeException: java.lang.ClassNotFoundException: 
[Lorg.apache.hadoop.dfs.Block;
java.lang.RuntimeException: java.lang.ClassNotFoundException: 
[Lorg.apache.hadoop.dfs.Block;
    at 
org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:177)
    at 
org.apache.hadoop.io.ObjectWritable.readFields(ObjectWritable.java:60)
    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:170)


Or...

060503 175932 Client connection to 127.0.0.1:9001 caught: 
java.lang.RuntimeException: java.lang.ClassNotFoundException: 
[Ljava.lang.String;
java.lang.RuntimeException: java.lang.ClassNotFoundException: 
[Ljava.lang.String;
    at 
org.apache.hadoop.io.ObjectWritable$NullInstance.readFields(ObjectWritable.java:94)
    at 
org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:230)
    at 
org.apache.hadoop.io.ObjectWritable.readFields(ObjectWritable.java:60)
    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:170)

I'd compiled hadoop with beta2 1.6.0:

[bregeon 1506] hadoop > /usr/local/jdk1.6.0/bin/java -version
java version "1.6.0-beta2"
Java(TM) SE Runtime Environment (build 1.6.0-beta2-b76)
Java HotSpot(TM) 64-Bit Server VM (build 1.6.0-beta2-b76, mixed mode)


After recompiling with 1.5.0_06, the above issues went away.

St.Ack





Doug Cutting (JIRA) wrote:
>      [ http://issues.apache.org/jira/browse/HADOOP-189?page=all ]
>
> Doug Cutting updated HADOOP-189:
> --------------------------------
>
>     Attachment: local-jar2.patch
>
> Here's a patch I've actually tested!
>
>   
>> Add job jar lib, classes, etc. to CLASSPATH when in standalone mode
>> -------------------------------------------------------------------
>>
>>          Key: HADOOP-189
>>          URL: http://issues.apache.org/jira/browse/HADOOP-189
>>      Project: Hadoop
>>         Type: New Feature
>>     
>
>   
>>   Components: mapred
>>     Reporter: stack@archive.org
>>  Attachments: local-jar.patch, local-jar2.patch
>>
>> Currently, in standalone mode,  hadoop is unable to launch other than the most basic
of job jars where 'basic' is a job jar with nought but class files at top level of the jar
with Main-Class pointing at entry point.  If the job jar has dependencies on jars under the
job jar lib or there are job jar plugins in the classes dir, etc.,  these dependencies are
not loaded and the job fails launch.
>>     
>
>   


Mime
View raw message