Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 69866200BB7 for ; Wed, 26 Oct 2016 01:35:15 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 66750160AFA; Tue, 25 Oct 2016 23:35:15 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id AE2FB160AD8 for ; Wed, 26 Oct 2016 01:35:14 +0200 (CEST) Received: (qmail 6597 invoked by uid 500); 25 Oct 2016 23:35:13 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 6585 invoked by uid 99); 25 Oct 2016 23:35:12 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Oct 2016 23:35:12 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5C39FC2268 for ; Tue, 25 Oct 2016 23:35:12 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id HfD4jztIfiGq for ; Tue, 25 Oct 2016 23:35:10 +0000 (UTC) Received: from mail-yb0-f181.google.com (mail-yb0-f181.google.com [209.85.213.181]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id B832B5F642 for ; Tue, 25 Oct 2016 23:35:09 +0000 (UTC) Received: by mail-yb0-f181.google.com with SMTP id h65so6524981ybb.7 for ; Tue, 25 Oct 2016 16:35:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=3I4MX80VXb0EgJ7MdYdTAiENxG0YkCX494E5acw4sNk=; b=zKg/Nw0Pg7rWcGQkMwLVa6I/h3YnqNVDpOKeHNwN2TyoFAfRJu9Lkipr0hWYRQauxO WdA1Ivrtm+bTNO+iL7vsp2WPCtIYlcHD3ZHxciF2iG0/A1AzXPCqH66ovUnW17TrXrxO oA1kUZVj7wcpm5ZkWegAfIyST3JzRc7/DW21QV3W7/kSznnBa2c9HQcZ22RkVtRdKTBA BvNvUKBYqJsP9SSi6h/gnnhi0WlbttwCh0AinqHP4KxBDEb136rM9SmfsoSZg9JOvPep bqQbxeXbc0MCpe7+V+SzScASYp8f5naq3woQWo0+Saj6MFUTxAznB+LBn0agnydvFrjF Hr0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=3I4MX80VXb0EgJ7MdYdTAiENxG0YkCX494E5acw4sNk=; b=DYYnMo65UwsfK6yFfy9/FiNFntxt8HifaFoktGMT3ZILD+qVB86zRTbhRqoWa9MMT8 tNBmpY43P+DvQsiTBu9yZg10hUN6XDoNjiETjGMqCYzvgewhk2k2SiYh6tq9AjEniskc o6hbjqz/1y20ykCQc2oaH43sBfkbyScWJ2zyMlbWm3lxCKEfzBfadV5o3tdvXXjowE1V KvcGgPW2GImKWvKCXWyQQYkOwCFYv5gv6UitTj5sIhPXkSIvtj1a0hqLJLkWQW3vknCg Bdf9YmL7mVUyk6CwcDmOJ4mqa9t+h8B8+hC292MZK0aRC7Qc22AtAMxBORqJpAh5g7mK d4vA== X-Gm-Message-State: ABUngvcqTYRfzFhvxoQY9yLUps6vWUSYRm29/t6aEZWux2VwSPSz8N6yAzeQPUgU2jyWk5gLVjpAAmhOmgFpBQ== X-Received: by 10.37.112.130 with SMTP id l124mr1906420ybc.21.1477438502664; Tue, 25 Oct 2016 16:35:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.114.212 with HTTP; Tue, 25 Oct 2016 16:35:01 -0700 (PDT) Received: by 10.37.114.212 with HTTP; Tue, 25 Oct 2016 16:35:01 -0700 (PDT) In-Reply-To: References: <1477381051.3083.108.camel@statsbiblioteket.dk> From: Pushkar Raste Date: Tue, 25 Oct 2016 19:35:01 -0400 Message-ID: Subject: Re: OOM Error To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=001a114bb6d821275f053fb8f5f0 archived-at: Tue, 25 Oct 2016 23:35:15 -0000 --001a114bb6d821275f053fb8f5f0 Content-Type: text/plain; charset=UTF-8 You should look into using docValues. docValues are stored off heap and hence you would be better off than just bumping up the heap. Don't enable docValues on existing fields unless you plan to reindex data from scratch. On Oct 25, 2016 3:04 PM, "Susheel Kumar" wrote: > Thanks, Toke. Analyzing GC logs helped to determine that it was a sudden > death. The peaks in last 20 mins... See http://tinypic.com/r/n2zonb/9 > > Will look into the queries more closer and also adjusting the cache sizing. > > > Thanks, > Susheel > > On Tue, Oct 25, 2016 at 3:37 AM, Toke Eskildsen > wrote: > > > On Mon, 2016-10-24 at 18:27 -0400, Susheel Kumar wrote: > > > I am seeing OOM script killed solr (solr 6.0.0) on couple of our VM's > > > today. So far our solr cluster has been running fine but suddenly > > > today many of the VM's Solr instance got killed. > > > > As you have the GC-logs, you should be able to determine if it was a > > slow death (e.g. caches gradually being filled) or a sudden one (e.g. > > grouping or faceting on a large new non-DocValued field). > > > > Try plotting the GC logs with time on the x-axis and free memory after > > GC on the y-axis. It it happens to be a sudden death, the last lines in > > solr.log might hold a clue after all. > > > > - Toke Eskildsen, State and University Library, Denmark > > > --001a114bb6d821275f053fb8f5f0--