hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sidharta Seethana (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-5040) CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100
Date Thu, 05 May 2016 02:19:12 GMT
Sidharta Seethana created YARN-5040:
---------------------------------------

             Summary: CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2
when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100
                 Key: YARN-5040
                 URL: https://issues.apache.org/jira/browse/YARN-5040
             Project: Hadoop YARN
          Issue Type: Bug
    Affects Versions: 2.9.0
            Reporter: Sidharta Seethana


/cc [~vvasudev]

We have been running some benchmarks internally with resource isolation enabled. We have consistently
run into kernel panics when running a large job ( a large pi job, terasort ). These kernel
panics wen't away when we set yarn.nodemanager.resource.percentage-physical-cpu-limit=100
. Anything less than 100 triggers different behavior in YARN's CPU resource handler which
seems to cause these issues. Looking at the kernel crash dumps, the backtraces were different
- sometimes pointing to java processes, sometimes not. 

Kernel versions used : 3.10.0-229.14.1.el7.x86_64 and 3.10.0-327.13.1.el7.x86_64 . 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message