hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mohammad Kamrul Islam (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-11364) [Java 8] Over usage of virtual memory
Date Mon, 08 Dec 2014 23:27:13 GMT
Mohammad Kamrul Islam created HADOOP-11364:

             Summary: [Java 8] Over usage of virtual memory
                 Key: HADOOP-11364
                 URL: https://issues.apache.org/jira/browse/HADOOP-11364
             Project: Hadoop Common
          Issue Type: Bug
            Reporter: Mohammad Kamrul Islam
            Assignee: Mohammad Kamrul Islam

In our Hadoop 2 + Java8 effort , we found few jobs are being Killed by Hadoop due to excessive
virtual memory allocation.  Although the physical memory usage is low.

The most common error message is "Container [pid=??,containerID=container_??] is running beyond
virtual memory limits. Current usage: 365.1 MB of 1 GB physical memory used; 3.2 GB of 2.1
GB virtual memory used. Killing container."

We see this problem for MR job as well as in spark driver/executor.

This message was sent by Atlassian JIRA

View raw message