Return-Path: X-Original-To: apmail-storm-dev-archive@minotaur.apache.org Delivered-To: apmail-storm-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 484A111083 for ; Wed, 9 Jul 2014 23:36:26 +0000 (UTC) Received: (qmail 70921 invoked by uid 500); 9 Jul 2014 23:36:26 -0000 Delivered-To: apmail-storm-dev-archive@storm.apache.org Received: (qmail 70875 invoked by uid 500); 9 Jul 2014 23:36:26 -0000 Mailing-List: contact dev-help@storm.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@storm.incubator.apache.org Delivered-To: mailing list dev@storm.incubator.apache.org Received: (qmail 70864 invoked by uid 99); 9 Jul 2014 23:36:25 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jul 2014 23:36:25 +0000 X-ASF-Spam-Status: No, hits=-2000.7 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 09 Jul 2014 23:36:24 +0000 Received: (qmail 70688 invoked by uid 99); 9 Jul 2014 23:36:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jul 2014 23:36:04 +0000 Date: Wed, 9 Jul 2014 23:36:04 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: dev@storm.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (STORM-375) Smarter downloading of assignments by supervisors and workers MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/STORM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056903#comment-14056903 ] ASF GitHub Bot commented on STORM-375: -------------------------------------- Github user nathanmarz commented on the pull request: https://github.com/apache/incubator-storm/pull/167#issuecomment-48548791 +1 > Smarter downloading of assignments by supervisors and workers > ------------------------------------------------------------- > > Key: STORM-375 > URL: https://issues.apache.org/jira/browse/STORM-375 > Project: Apache Storm (Incubating) > Issue Type: Improvement > Reporter: Kyle Nusbaum > > Periodically the supervisors and workers each download their assignments from zookeeper, and the traffic begins to saturate the network and hammer zookeeper as we scale. Having these daemons only grab the assignments when the zookeeper path's version number changes reduces this traffic considerably, along with STORM-376. -- This message was sent by Atlassian JIRA (v6.2#6252)