aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Farner (JIRA)" <>
Subject [jira] [Created] (AURORA-117) Scheduler performance issues with very large jobs
Date Sat, 25 Jan 2014 04:13:39 GMT
Bill Farner created AURORA-117:

             Summary: Scheduler performance issues with very large jobs
                 Key: AURORA-117
             Project: Aurora
          Issue Type: Task
          Components: Scheduler
            Reporter: Bill Farner

The scheduler tends to have performance issues when scheduling very large jobs.  We've observed
this with jobs exceeding 2000 instances.  The {{TaskScheduler}} thread tends to consume a
large amount of CPU (100%, limited by the global storage lock).  Current hypothesis is that
the majority of the time is spent satisfying diversity constraints (rack, machine), which
require expensive queries.

This message was sent by Atlassian JIRA

View raw message