Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9C39A200D37 for ; Thu, 9 Nov 2017 16:16:48 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 9AE89160C02; Thu, 9 Nov 2017 15:16:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E0C791609E5 for ; Thu, 9 Nov 2017 16:16:47 +0100 (CET) Received: (qmail 56506 invoked by uid 500); 9 Nov 2017 15:16:46 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 56495 invoked by uid 99); 9 Nov 2017 15:16:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Nov 2017 15:16:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 2780E1A0B1B for ; Thu, 9 Nov 2017 15:16:46 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.972 X-Spam-Level: X-Spam-Status: No, score=0.972 tagged_above=-999 required=6.31 tests=[SPF_HELO_PASS=-0.001, SPF_SOFTFAIL=0.972, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id vSicnaZPqVCv for ; Thu, 9 Nov 2017 15:16:45 +0000 (UTC) Received: from n6.nabble.com (n6.nabble.com [162.255.23.37]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 71E9261218 for ; Thu, 9 Nov 2017 15:15:56 +0000 (UTC) Received: from n6.nabble.com (localhost [127.0.0.1]) by n6.nabble.com (Postfix) with ESMTP id 39A702C520A8 for ; Thu, 9 Nov 2017 08:15:56 -0700 (MST) Date: Thu, 9 Nov 2017 08:15:56 -0700 (MST) From: dkarachentsev To: user@ignite.apache.org Message-ID: <1510240556233-0.post@n6.nabble.com> In-Reply-To: <1509637774810-0.post@n6.nabble.com> References: <1507885135567-0.post@n6.nabble.com> <7C2B937A-461E-46D7-BC2C-FA0C803C812A@apache.org> <1508139344167-0.post@n6.nabble.com> <1508164779934-0.post@n6.nabble.com> <1508313009674-0.post@n6.nabble.com> <1508856482975-0.post@n6.nabble.com> <1509528215555-0.post@n6.nabble.com> <1509611890932-0.post@n6.nabble.com> <1509637774810-0.post@n6.nabble.com> Subject: Re: Benchmark results questions MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit archived-at: Thu, 09 Nov 2017 15:16:48 -0000 Hi Ray, I've finally got results of query benchmarks: 4s1c 80725.80 80725.80 4s2c 78797.90 157595.80 4s4c 54029.70 216118.80 8s1c 64185.60 64185.60 8s2c 61058.10 122116.20 8s4c 34792.70 139170.80 First column - cluster configuration (in 8 server variant 2 nodes per machine), second - average throughput per driver, third - total throughput. So there is some degradation on larger cluster. First of all, queries does not scale, you need broadcast the same request to all nodes. Adding more nodes doesn't make this job easier, but even harder, because client has to process more requests and responses - that's what I see from profiler. In larger cluster client consumes more CPU, more IO and increases pressure to GC. On the 8s4c configuration two servers on single machine influence on work of each other. Opposite to SQL, single put/get requests are targeted on primary node only, not to all, and adding more nodes gives almost linear increasing of throughput. You will get increasing of query performance on large grid with much bigger dataset and more complex SQL. In that case processing would be spreaded among servers and data digesting will be parallelized. Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/