hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Baclace (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4953) config property mapred.child.java.opts has maximum length that generates NoClassDefFoundError if exceeded
Date Mon, 29 Dec 2008 22:05:44 GMT
config property mapred.child.java.opts has maximum length that generates NoClassDefFoundError
if exceeded
---------------------------------------------------------------------------------------------------------

                 Key: HADOOP-4953
                 URL: https://issues.apache.org/jira/browse/HADOOP-4953
             Project: Hadoop Core
          Issue Type: Bug
          Components: conf
    Affects Versions: 0.19.0
            Reporter: Paul Baclace


There is an unexpected max length for the value of config property mapred.child.java.opts
that, if exceeded, generates an opaque NoClassDefFoundError in child tasks.  

The max length for the value is 146 chars.  A length of 147 chars will cause the exception.
 For example, adding a single extra space between options will convert a working jvm opts
clause into one that always generates NoClassDefFoundError when tasktrackers exec child tasks.

As laboriously diagnosed, conf/hadoop-site.xml  was used to set the property and runs were
done on "Amazon EC2 Ubuntu 8.04 hardy AMI" (Debian version "lenny/sid") using java 1.6.0_07-b06.
 Multiple slaves nodes were used and after conf changes, stop-all.sh and start-all.sh were
run before each test.  The job config props as found on the slave did not appear to have a
truncated or damaged value.  It made no difference whether @taskid@ appeared at the end or
middle of the options and absence of @taskid@ did not eliminate the problem.

This bug wastes considerable time because the error looks like a classpath problem and even
after the java opts property is suspected, a character quoting or unsupported option seems
more likely than a length limit.  



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message