mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MESOS-265) Master hogs CPU
Date Thu, 30 Aug 2012 00:28:07 GMT
James Zhao created MESOS-265:
--------------------------------

             Summary: Master hogs CPU
                 Key: MESOS-265
                 URL: https://issues.apache.org/jira/browse/MESOS-265
             Project: Mesos
          Issue Type: Bug
          Components: master
         Environment: * Cluster of 6 CentOS machines; 24 cores / 256G RAM each.
* Large data file (1b records, 100GB) retrieved via HDFS.
* Simple jobs (eg. count records by key, where key takes 20 possible values) using Spark with
local modifications.
            Reporter: James Zhao


CPU usage of the master slowly grows until eventually it stops working.

Upon launch, CPU usage is about 1%. After running just 1 job, it climbs to 20% (even after
the job has stopped), and upon running more jobs, quickly grows to 50%. It then continues
to grow at a slower rate until eventually it stops responding (after perhaps several hundred
jobs).

Screenshot: http://math.stanford.edu/~jyzhao/mesos-cpu.png (there are no active jobs, but
lt-mesos-master is using 75% CPU)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message