Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E48B02009C6 for ; Tue, 17 May 2016 05:57:00 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id E318F160A19; Tue, 17 May 2016 03:57:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 36E47160A16 for ; Tue, 17 May 2016 05:57:00 +0200 (CEST) Received: (qmail 30005 invoked by uid 500); 17 May 2016 03:56:58 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 29991 invoked by uid 99); 17 May 2016 03:56:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 May 2016 03:56:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 97886180547 for ; Tue, 17 May 2016 03:56:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.802 X-Spam-Level: X-Spam-Status: No, score=-0.802 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id DbznTauVI5K4 for ; Tue, 17 May 2016 03:56:55 +0000 (UTC) Received: from mail-io0-f177.google.com (mail-io0-f177.google.com [209.85.223.177]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id BA2345F29C for ; Tue, 17 May 2016 03:56:54 +0000 (UTC) Received: by mail-io0-f177.google.com with SMTP id 190so8379421iow.1 for ; Mon, 16 May 2016 20:56:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-transfer-encoding; bh=gAu4hOFavNv+AMgVPxaVp0Wf5vfVUecaOPVrWQMsPSc=; b=WI7F1CbOXkPLRg1vlagb7m52c2k9RBPc1X18U3UQOfe5vJhL8Ucsq8aHNYbLAckDN/ b1iAniygJLPbGWeN5HDpraopxh5mWPRw6SKYeTg9DY7FzUwiKXcC/+NeiOpgG/EYsWiQ m4YXwOdInEFhE7VQL7zsLzYFzGo5Wp2Jw3IuuAdU5q1dcr0+Zv0l8e4tR6ejiB2hyr7R wL3mC6JhSmdShxjoxa9aEtLSZunayh6hHDZXOVdFSXImSLXTXy9WiqRkosZqk7j6AH0L iZxiL4U7FE57F8K541rFW/u68131PdVkQQUFXejtRjnv7tYo40SBBanVf1VEtQS5y2lW 0M6A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-transfer-encoding; bh=gAu4hOFavNv+AMgVPxaVp0Wf5vfVUecaOPVrWQMsPSc=; b=LD07A5L/hj63GibIEaxGcAgiqXe4OBjE9diFIzB9wCFk46MO9NUqgwdIor6N5sWhMz TKr7Jq/YY++KI30UuMwKRBlajoZmP5JKt3T3e2yIlzQ9HwH2TwtIiPK14qjKLip3TdHN GwH0eoSZ5+42XKcX21AxZN/mzFub7tuvScwnxQ+Bvnqyn6G8ddzQoUy/fBZCQjZcYQ+b atl9jlgDUM3BFPCEuyhwySJ+w5yVqW0knvOKbiDt2Mc8Ail1iXE01hbwZj/lVS986z6Q NjHOj+sRNKghHjxkibIcTYoD/L/RbqOXpsqViNXT4PCiiLssNeC2VkimZH/j54SSsthb ziig== X-Gm-Message-State: AOPr4FWuq5A/Sx3Z/GN8fD3j05g8jefCeKlaOZ+ooCp1hHobrqhDOtAgiwvHX9VBhRoNsa6mrCEY6rf4vilmeA== X-Received: by 10.107.135.74 with SMTP id j71mr20856005iod.158.1463457407734; Mon, 16 May 2016 20:56:47 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.12.18 with HTTP; Mon, 16 May 2016 20:56:28 -0700 (PDT) In-Reply-To: <6D2B83DA-4F58-46D2-90CE-E7ADAF631BB2@whitepages.com> References: <6D2B83DA-4F58-46D2-90CE-E7ADAF631BB2@whitepages.com> From: Erick Erickson Date: Mon, 16 May 2016 20:56:28 -0700 Message-ID: Subject: Re: state.json being downloaded every 10 seconds To: solr-user Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable archived-at: Tue, 17 May 2016 03:57:01 -0000 With the per-collection state.json, if "something" goes to a node that does= n't host a replica for a node, it downloads the state for the "other" collection then throws it away. In this case, "something" is apparently asking the nodes hosting collection= A to do "something" with collections B and/or C. Some support for this would be if further investigation shows that the nodes that _do_ re-download the info did _not_ have replicas B and C. What the "something" is that sends requests I'm not quite sure, but that's a place to start. Best, Erick On Mon, May 16, 2016 at 11:08 AM, Jeff Wartes wrot= e: > > I have a solr 5.4 cluster with three collections, A, B, C. > Nodes either host replicas for collection A, or B and C. Collections B an= d C are not currently used - no inserts or queries. Collection A is getting= significant query traffic, but no insert traffic, and queries are only dir= ected to nodes hosting replicas for collection A. ZK timeout is set to 15 s= econds. > > I=E2=80=99ve noticed via tcpdump that, every 10 seconds exactly, several = of the nodes (but not all) hosting collection A re-download the state.json = for collections B and C. This behavior survives JVM restart. > > This isn=E2=80=99t a huge deal, the extra traffic isn=E2=80=99t very mean= ingful, but it=E2=80=99s odd and smells like a bug somewhere. Anyone seen s= omething like this? > >