Mailing-List: contact mesos-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mesos-dev@incubator.apache.org
Date: Thu, 30 Aug 2012 12:00:08 +1100 (NCT)
From: "James Zhao (JIRA)" <jira@apache.org>
To: mesos-dev@incubator.apache.org
Message-ID: <2050937982.14681.1346288408185.JavaMail.jiratomcat@arcas>
In-Reply-To: <1813929466.14632.1346286487429.JavaMail.jiratomcat@arcas>
Subject: [jira] [Commented] (MESOS-265) Master hogs CPU
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MESOS-265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444581#comment-13444581 ] 

James Zhao commented on MESOS-265:
----------------------------------

http://math.stanford.edu/~jyzhao/mesos-log.txt
                
> Master hogs CPU
> ---------------
>
>                 Key: MESOS-265
>                 URL: https://issues.apache.org/jira/browse/MESOS-265
>             Project: Mesos
>          Issue Type: Bug
>          Components: master
>         Environment: * Cluster of 6 CentOS machines; 24 cores / 256G RAM each.
> * Large data file (1b records, 100GB) retrieved via HDFS.
> * Simple jobs (eg. count records by key, where key takes 20 possible values) using Spark with local modifications.
>            Reporter: James Zhao
>
> CPU usage of the master slowly grows until eventually it stops working.
> Upon launch, CPU usage is about 1%. After running just 1 job, it climbs to 20% (even after the job has stopped), and upon running more jobs, quickly grows to 50%. It then continues to grow at a slower rate until eventually it stops responding (after perhaps several hundred jobs).
> Screenshot: http://math.stanford.edu/~jyzhao/mesos-cpu.png (there are no active jobs, but lt-mesos-master is using 75% CPU)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira