mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Farner (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MESOS-409) Master detector code should stat nodes before attempting to create
Date Thu, 21 Mar 2013 00:35:15 GMT
Bill Farner created MESOS-409:
---------------------------------

             Summary: Master detector code should stat nodes before attempting to create
                 Key: MESOS-409
                 URL: https://issues.apache.org/jira/browse/MESOS-409
             Project: Mesos
          Issue Type: Improvement
          Components: slave
            Reporter: Bill Farner
            Priority: Minor


The master detector code currently recursively walks the permanent node path (e.g. /home/mesos/cluster),
attempting to create /home, then /home/mesos, then /home/mesos/cluster; trapping NoAuth and
NodeExists errors along the way.

A simple performance improvement would be to perform a stat on the full permanent path and
skip the recursive creation if it exists.  Alternatively, it seems practical to forego node
creation by the slave altogether, and have the slave commit suicide if the permanent node
is not present.

The current behavior results in reams of zookeeper server logging when there is a master failover,
as user errors are logged by default (which we'd prefer to retain).  I'm not sure what the
performance impact this has on ZooKeeper, but it's non-zero and a fix seems trivial.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message