hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jai Kumar Singh (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-7989) [ec2] hadoop Could not create the Java virtual machine
Date Sat, 21 Jan 2012 18:29:40 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jai Kumar Singh updated HADOOP-7989:
------------------------------------

    Description: 
On Amazon EC2, If I set mapred.child.java.opts to "-Xmx512m". Job execution fails saying that
"Could Not create the java virtual machine"
If unset mapred.child.java.opts everything runs fine. I've even tried the same thing on c1.xlarge
instances but with the same result. 
I'll add full logs. I need to set mapred.child.java.opts becuase my reduce program are memory
hungry.

I've been trying to setup a map-reduce cluster on ec2 for last two days via whirr, but this
error was recurring. At first I thought It might be whirr
specific, but manual ec2 cluster also resulted in same. 

<snippet>
ubuntu@ip-10-84-237-173:~/workspace$ hadoop jar $HADOOP_HOME/*examples*.jar  wordcount in
out
12/01/21 18:08:28 INFO input.FileInputFormat: Total input paths to process : 16
12/01/21 18:08:28 INFO mapred.JobClient: Running job: job_201201211751_0007
12/01/21 18:08:29 INFO mapred.JobClient:  map 0% reduce 0% 
12/01/21 18:08:35 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_0, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:35 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stdout
12/01/21 18:08:35 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stderr
12/01/21 18:08:41 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_r_000002_0, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:41 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stdout
12/01/21 18:08:41 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stderr
12/01/21 18:08:47 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_1, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:47 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stdout
12/01/21 18:08:47 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stderr
12/01/21 18:08:53 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_r_000002_1, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:53 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stdout
12/01/21 18:08:53 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stderr
12/01/21 18:09:01 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_2, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
</snippet>

<snippet>
ubuntu@ip-10-12-15-189:~/workspace$ cat ~/hadoop/logs/userlogs/job_201201211751_0007/attempt_201201211751_0007_m_000016_1/std*
Could not create the Java virtual machine.
Error occurred during initialization of VM
Could not reserve enough space for object heap
ubuntu@ip-10-12-15-189:~/workspace$ 
</snippet>

  was:
On Amazon EC2, If I set mapred.child.java.opts to "-Xmx512m". Job execution fails saying that
"Could Not create the java virtual machine"
If unset mapred.child.java.opts everything runs fine. I've even tried the same thing on c1.xlarge
instances but with the same result. 
I'll add full logs. I need to set mapred.child.java.opts becuase my reduce program are memory
hungry.

I've been trying to setup a map-reduce cluster on ec2 for last two days via whirr, but this
error was recurring. At first I thought It might be whirr
specific, so I manuualy setting up the cluster also resulted in same. 

<snippet>
ubuntu@ip-10-84-237-173:~/workspace$ hadoop jar $HADOOP_HOME/*examples*.jar  wordcount in
out
12/01/21 18:08:28 INFO input.FileInputFormat: Total input paths to process : 16
12/01/21 18:08:28 INFO mapred.JobClient: Running job: job_201201211751_0007
12/01/21 18:08:29 INFO mapred.JobClient:  map 0% reduce 0% 
12/01/21 18:08:35 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_0, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:35 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stdout
12/01/21 18:08:35 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stderr
12/01/21 18:08:41 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_r_000002_0, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:41 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stdout
12/01/21 18:08:41 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stderr
12/01/21 18:08:47 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_1, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:47 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stdout
12/01/21 18:08:47 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stderr
12/01/21 18:08:53 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_r_000002_1, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/01/21 18:08:53 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stdout
12/01/21 18:08:53 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stderr
12/01/21 18:09:01 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_2, Status
: FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
</snippet>

<snippet>
ubuntu@ip-10-12-15-189:~/workspace$ cat ~/hadoop/logs/userlogs/job_201201211751_0007/attempt_201201211751_0007_m_000016_1/std*
Could not create the Java virtual machine.
Error occurred during initialization of VM
Could not reserve enough space for object heap
ubuntu@ip-10-12-15-189:~/workspace$ 
</snippet>

    
> [ec2] hadoop Could not create the Java virtual machine
> ------------------------------------------------------
>
>                 Key: HADOOP-7989
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7989
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>         Environment: Amazon EC2 m1.large instance (AMI-ID ami-fd589594)
>            Reporter: Jai Kumar Singh
>
> On Amazon EC2, If I set mapred.child.java.opts to "-Xmx512m". Job execution fails saying
that "Could Not create the java virtual machine"
> If unset mapred.child.java.opts everything runs fine. I've even tried the same thing
on c1.xlarge instances but with the same result. 
> I'll add full logs. I need to set mapred.child.java.opts becuase my reduce program are
memory hungry.
> I've been trying to setup a map-reduce cluster on ec2 for last two days via whirr, but
this error was recurring. At first I thought It might be whirr
> specific, but manual ec2 cluster also resulted in same. 
> <snippet>
> ubuntu@ip-10-84-237-173:~/workspace$ hadoop jar $HADOOP_HOME/*examples*.jar  wordcount
in out
> 12/01/21 18:08:28 INFO input.FileInputFormat: Total input paths to process : 16
> 12/01/21 18:08:28 INFO mapred.JobClient: Running job: job_201201211751_0007
> 12/01/21 18:08:29 INFO mapred.JobClient:  map 0% reduce 0% 
> 12/01/21 18:08:35 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_0,
Status : FAILED
> java.lang.Throwable: Child Error
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:35 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stdout
> 12/01/21 18:08:35 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stderr
> 12/01/21 18:08:41 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_r_000002_0,
Status : FAILED
> java.lang.Throwable: Child Error
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:41 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stdout
> 12/01/21 18:08:41 WARN mapred.JobClient: Error reading task outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stderr
> 12/01/21 18:08:47 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_1,
Status : FAILED
> java.lang.Throwable: Child Error
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:47 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stdout
> 12/01/21 18:08:47 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stderr
> 12/01/21 18:08:53 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_r_000002_1,
Status : FAILED
> java.lang.Throwable: Child Error
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:53 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stdout
> 12/01/21 18:08:53 WARN mapred.JobClient: Error reading task outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stderr
> 12/01/21 18:09:01 INFO mapred.JobClient: Task Id : attempt_201201211751_0007_m_000017_2,
Status : FAILED
> java.lang.Throwable: Child Error
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> </snippet>
> <snippet>
> ubuntu@ip-10-12-15-189:~/workspace$ cat ~/hadoop/logs/userlogs/job_201201211751_0007/attempt_201201211751_0007_m_000016_1/std*
> Could not create the Java virtual machine.
> Error occurred during initialization of VM
> Could not reserve enough space for object heap
> ubuntu@ip-10-12-15-189:~/workspace$ 
> </snippet>

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message