Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2035B200D4E for ; Fri, 17 Nov 2017 03:08:42 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 1D2B1160BF4; Fri, 17 Nov 2017 02:08:42 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 647AF160BEA for ; Fri, 17 Nov 2017 03:08:41 +0100 (CET) Received: (qmail 19497 invoked by uid 500); 17 Nov 2017 02:08:39 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Delivered-To: moderator for java-user@lucene.apache.org Received: (qmail 81343 invoked by uid 99); 16 Nov 2017 22:03:29 -0000 X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.129 X-Spam-Level: ** X-Spam-Status: No, score=2.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=nXuAs1jvMuH2PQHGcUSA3/B9ARhYSBadHHseThLpzoU=; b=RzzndEEvECm9wLa/hDCLJINK3acMpy5To6XKEOBepZxlrjoioa+Ue2+6/XUSjWOQ2A vJBeA7YD0pwRmVlnsUZNKHcKZAGba4orkYIDLWncVjqKXDhhCIpVSSoB6nrJj/L4kkhP Rx90IpjxNXu5osjsiwp3S0ez6kGwsvgsp56RW9Uc6DXNl1pDWP3Vdx457Uuxd+v0+mRB 2FTCZgj0/WkwnF2WW/gPVwPzv/280cyKYqguphTykSB0E7ySzjZgvL41HR+iHlOADrEG UhBrx7BQ7bqTaHlLuSUCk6WFWm0T/8fXFOIVxzKMeH678gAdiIPY237KrnFgj2RjKugI +0iQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=nXuAs1jvMuH2PQHGcUSA3/B9ARhYSBadHHseThLpzoU=; b=GGTm/c3f9/f5bq8VkA7TYF6zerEB/xhzC0WU6wFep7kDto6BxM42SWQ3kRzfSUUnyg lYmG+52ss6yOYvQ1SJhzTYAZVBl5KMCJytpcjH5cQf/PqMlL48DHMTF1XH04/CMIMGC0 8W4kkKJhhTnnefnV9b/qy6ViQ/M9bf2rpjoR/ZTbXW30kmfbdgonaqFxafuUtsMy1GCi 4T/n/xP8Q1fX+7rGAoyONCRItj4CYyon4E40N/Qu0AGf008cDg+N7IeODyL62DBKE52v 0UjfGHeaZlRWQjKA81wnv/N5dV+m3fOIm08bRFymoJvtLnmo2qYfuAHDkYEH0RO9jeVh Ipyg== X-Gm-Message-State: AJaThX77Hn3v6iOx+m37zYbGkoazxhRbc7Bf/RiAZvCIkEXmTGeuKrtU nBmwmDYLzAP2ugI3ui2znD30Ulyynrvxv1fgwKM= X-Google-Smtp-Source: AGs4zMaxZ1Z2s8pzjpWNb+0YZ1zU824q2iWZRQqnaB1emiYCDron5p0ruyRiAtNLNhMB3HoLJ0WdoMLDXqhq7ahQX2Y= X-Received: by 10.202.60.3 with SMTP id j3mr2067749oia.236.1510869805324; Thu, 16 Nov 2017 14:03:25 -0800 (PST) MIME-Version: 1.0 From: Eli Revach Date: Fri, 17 Nov 2017 00:03:25 +0200 Message-ID: Subject: Optimize FTS memory footprint To: java-user@lucene.apache.org Content-Type: multipart/alternative; boundary="001a113cd1a20c6326055e20ca7a" archived-at: Fri, 17 Nov 2017 02:08:42 -0000 --001a113cd1a20c6326055e20ca7a Content-Type: text/plain; charset="UTF-8" Hi I am using Elasticserach 1.7.5 , our segment memory allocation per node is very big , its seems like related to FST . 1) Amy way to reduce /optimze its size ( i understed its the index for the terms) ? 2) Did index optimize can help ? 2) The fact that we used nested objects can dramticly the allocation of memory for it ? Thanks --001a113cd1a20c6326055e20ca7a--