Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 551FC200BC7 for ; Fri, 11 Nov 2016 00:44:30 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 53ACD160B10; Thu, 10 Nov 2016 23:44:30 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 999CC160B01 for ; Fri, 11 Nov 2016 00:44:29 +0100 (CET) Received: (qmail 94013 invoked by uid 500); 10 Nov 2016 23:44:23 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 94001 invoked by uid 99); 10 Nov 2016 23:44:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Nov 2016 23:44:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 51E6D185F03 for ; Thu, 10 Nov 2016 23:44:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.209 X-Spam-Level: ** X-Spam-Status: No, score=2.209 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, PLING_QUERY=0.279, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id ohq0Aa1ULlhA for ; Thu, 10 Nov 2016 23:44:20 +0000 (UTC) Received: from mail-it0-f45.google.com (mail-it0-f45.google.com [209.85.214.45]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 446895F65A for ; Thu, 10 Nov 2016 23:44:20 +0000 (UTC) Received: by mail-it0-f45.google.com with SMTP id q124so272465420itd.1 for ; Thu, 10 Nov 2016 15:44:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=4JqaulN80yfMTq8Cd2iquppZtPpVss6/sUtfv6D00M0=; b=YvD3e1wIEU5BqVshQ82x1cmhbFGhVGZFXrt2fQHqOD4ynoRSAUoKnXZHH0vwEJizna itgH2LkZMssgKHDoh5/wcV8fwQjByd+cvkV0DKKn0Qgh2iXs+8IcLmpGbRFuPrLyBQ5l f47OtTx4CW7ZAzRbeeMd0MpT2h4de43PPOiMhr7RJqUmVEojJXCeYoic6vlb1uEFDboq 7CUgqKGZF467ExNdyQB7c7s0VzhFLSUKUBzkp8scHoDjwrLh73OXdQTZVdw6wPtcHor4 dAr+aNRV+vFXol22dH2LHFGtmU76qQgHGA653SUsh9CVr8rGQZNEcyS40GnnJpfkFS9z ldpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=4JqaulN80yfMTq8Cd2iquppZtPpVss6/sUtfv6D00M0=; b=PZaLRzVjBa4fUVWVhbP7aI0RHVZUX6FBMlh9KHh0W3TrDu9KD12RUXBzb5/kcCpDLS Lns9u0P7oScNfbG3cvyBDZO2JiTNZ7hhSN860sBNaYKlM1quV5l5HZ3qPcovJ5fAmUJo rFfOL3/0EY42rjmO5KJDRJWtVQNTDp549ZBNZXdogxKsooavQc+dXdiCu3zetEZge1M0 Vq1l4uwhjRTyrMVh1T+A3DQ6lnJZE+ceaaJX20bGpZ1zRP1YAUfcJXOWSlSF6hdYmhDd xsAdEv3UaUOqvbFsFAsn9hmby5++LMCl9zBZIoc+mPxglLEQWqdANtunTbA4R0CzhHSP pTqw== X-Gm-Message-State: ABUngve8it0pJNVvW4MS00IuMHNZ7cilXIvRmJZJaqR3PKQEXubc9eSm4sAKZvV7jV9a0VQNxG611jn6XKLRdA== X-Received: by 10.157.54.183 with SMTP id h52mr108314otc.28.1478821457507; Thu, 10 Nov 2016 15:44:17 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.54.75 with HTTP; Thu, 10 Nov 2016 15:44:02 -0800 (PST) In-Reply-To: References: From: Kevin Risden Date: Thu, 10 Nov 2016 18:44:02 -0500 Message-ID: Subject: Re: Sorl shards: very sensitive to swap space usage !? To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=001a113d1d7ca93a990540faf361 archived-at: Thu, 10 Nov 2016 23:44:30 -0000 --001a113d1d7ca93a990540faf361 Content-Type: text/plain; charset=UTF-8 Agreed with what Shawn and Erick said. If you don't see anything in the Solr logs and your servers are swapping a lot, this could mean the Linux OOM killer is killing the Solr process (and maybe others). There is usually a log of this depending on your Linux distribution. Kevin Risden On Thu, Nov 10, 2016 at 6:42 PM, Shawn Heisey wrote: > On 11/10/2016 3:20 PM, Chetas Joshi wrote: > > I have a SolrCloud (Solr 5.5.0) of 50 nodes. The JVM heap memory usage > > of my solr shards is never more than 50% of the total heap. However, > > the hosts on which my solr shards are deployed often run into 99% swap > > space issue. This causes the solr shards go down. Why solr shards are > > so sensitive to the swap space usage? The JVM heap is more than enough > > so the shards should never require the swap space. What could be the > > reason? Where can find the reason why the solr shards go down. I don't > > see anything on the solr logs. > > If the machine that Solr is installed on is using swap, that means > you're having serious problems, and your performance will be TERRIBLE. > This kind of problem cannot be caused by Solr if it is properly > configured for the machine it's running on. > > Solr is a Java program. That means its memory usage is limited to the > Java heap, plus a little bit for Java itself, and absolutely cannot go > any higher. If the Java heap is set too large, then the operating > system might utilize swap to meet Java's memory demands. The solution > is to set your Java heap to a value that's significantly smaller than > the amount of available physical memory. Setting the heap to a value > that's close to (or more than) the amount of physical memory, is a > recipe for very bad performance. > > You need to also limit the memory usage of other software installed on > the machine, or you might run into a situation where swap is required > that is not Solr's fault. > > Thanks, > Shawn > > --001a113d1d7ca93a990540faf361--