From solr-user-return-140068-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Fri Mar 23 20:13:31 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 63A7318064D for ; Fri, 23 Mar 2018 20:13:31 +0100 (CET) Received: (qmail 24711 invoked by uid 500); 23 Mar 2018 19:13:29 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 24699 invoked by uid 99); 23 Mar 2018 19:13:28 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2018 19:13:28 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 28494C018B for ; Fri, 23 Mar 2018 19:13:28 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.908 X-Spam-Level: * X-Spam-Status: No, score=1.908 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id oReNb2LsvG1A for ; Fri, 23 Mar 2018 19:13:26 +0000 (UTC) Received: from mail-pf0-f171.google.com (mail-pf0-f171.google.com [209.85.192.171]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id B2F275F36A for ; Fri, 23 Mar 2018 19:13:25 +0000 (UTC) Received: by mail-pf0-f171.google.com with SMTP id v66so2618838pfv.7 for ; Fri, 23 Mar 2018 12:13:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=d7AOm3jpDqV01um6ggvX1W7fyveviUTdnZApdgVu5KM=; b=RT7Sh2871x3RBbPKfTMxJbZTlKXwdS4L8Ux+n3/3LcNBilsVbTh55zGD87gcrZFz4B yhDnEy7/98QV/awsDbTDNhEWOvgA+jLYvo84XiWDz7DbRiX9xu06Cv085Hw2JPtstTeI b2nDNdYF/yVmtzrhQTfczu66rhCb5j4vwatzl/zBo/ZJyJSzT8oCv25JzZN9CYwPKdcJ VpHFYrjaldl6lkt9TTbgI5QbE0LCQpNUVjqA6cFJsDl352Ft4c0cQxfAL9HtRqJrGWlO OjfMSUkEUjbwNl+EA2YpYvpXboe0cG9SOCEzx6ToqUJyo73nXfP4Jclw4C35yPFJp+Ff zRtQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=d7AOm3jpDqV01um6ggvX1W7fyveviUTdnZApdgVu5KM=; b=B4PWAkNBxCYP3ekXrA46HJBSBCZKBL4+yXIsoXu8R8VeETSvxGu5KCW5z9mfnnYFUh AC07FIbE6jul2Ykn8sdaHcTs1EulaEezlIfg9fw3S9dKVK4Yn7CPTZTh0lm0tMAoN7y1 Fj4saUxsD1jKb2n/ExuQei5kMtr/pH2LbuI7P+chrv1sb56hVJgEfwMfTld4x788wEp/ rTtSaZjFxrqhXPVQ2GUSyvgUxBcN08Yzma4rz2CAWaS+R65HGUAVEz1FGfqB7O89UbUv imqWXMaJFONBUQNQ6UcKfTd5C/tsw60MDC22vTt819W0nyB1DGmc9ZnLbGdZid+XihSN sr7A== X-Gm-Message-State: AElRT7GSHpsUGswMnbtQxEN04qV/Ju8ZHHTDIWtEkijsbT79ob44o4YE fS1R+DZDCVkm2+tF7TD7TNCB6WUHyWkvePIBpxO6 X-Google-Smtp-Source: AG47ELvKK18nBPkeEwZGwjDyNq/m+hEcfu0Y+jhbSMFj/zsD4v3aMLwZbvG7S0nW086Ri2GpdsBUau2UDuQLRoDqcP0= X-Received: by 10.99.147.25 with SMTP id b25mr7591844pge.309.1521832398743; Fri, 23 Mar 2018 12:13:18 -0700 (PDT) MIME-Version: 1.0 Received: by 10.100.241.136 with HTTP; Fri, 23 Mar 2018 12:13:17 -0700 (PDT) In-Reply-To: <14b54eaf-e068-bcaa-b628-64e9bdcbc512@elyograg.org> References: <4eb975df-51fb-e610-8cd7-d60ec3fdd71b@elyograg.org> <00fd09ab-5a24-9d8d-cda6-81302d7acab1@elyograg.org> <490f6d5d-4ed5-0a75-468e-51ec32023e36@elyograg.org> <975b9c1d-4e03-fe04-01ad-148853e4e3c5@elyograg.org> <14b54eaf-e068-bcaa-b628-64e9bdcbc512@elyograg.org> From: Deepak Goel Date: Sat, 24 Mar 2018 00:43:17 +0530 Message-ID: Subject: Re: Some performance questions.... To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary="f403045c690688eb9e0568193799" --f403045c690688eb9e0568193799 Content-Type: text/plain; charset="UTF-8" Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deicool@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, Go Green" On Fri, Mar 23, 2018 at 11:38 PM, Shawn Heisey wrote: > On 3/23/2018 11:21 AM, Deepak Goel wrote: > >> I tried the above suggestion. The throughput and utilisation remain the > >> same (they dont increase even if I increase the load). The response time > >> comes down. > >> > > Are you still creating a new client object for every query? Changing > how the client object is created won't improve anything if you're still > making a new one every time. > > You're going to need to move the client creation somewhere else in your > code that only gets run once at startup, and then use the already-built > client object in the code that does the query. The different way of > creating the client object that I gave you will ensure that it is > actually capable of running concurrently with many threads. (With some > older versions, this is not guaranteed) > > Yes I am now creating a client object only once. On Linux it has superb results (performance improves by around two times). However on Windows it has no improvement *SoftwareThroughput (/sec)Response Time (msec)Utilization (%CPU)UnTuned (Windows)27.8142665UnTuned (Linux)34528091Partially Tuned with Shawn's suggestions (Linux)56417290Partially Tuned with Shawn's suggestions (Windows)28.11.10560* Thanks, > Shawn > > > > --f403045c690688eb9e0568193799--