From issues-return-98387-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Wed Sep 4 09:11:04 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 09DFE180674 for ; Wed, 4 Sep 2019 11:11:03 +0200 (CEST) Received: (qmail 13271 invoked by uid 500); 4 Sep 2019 13:42:16 -0000 Mailing-List: contact issues-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list issues@ignite.apache.org Received: (qmail 13219 invoked by uid 99); 4 Sep 2019 13:42:16 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Sep 2019 13:42:16 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 68A98E3121 for ; Wed, 4 Sep 2019 09:11:02 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 7A72A782278 for ; Wed, 4 Sep 2019 09:11:00 +0000 (UTC) Date: Wed, 4 Sep 2019 09:11:00 +0000 (UTC) From: "Alexey Goncharuk (Jira)" To: issues@ignite.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (IGNITE-12087) Transactional putAll - significant performance drop on big batches of entries. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/IGNITE-12087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Goncharuk updated IGNITE-12087: -------------------------------------- Description: After IGNITE-5227 have been fixed I found significant performance drop in putAll operation. Insertion of 30_000 entries before IGNITE-5227 took ~1 second. After IGNITE-5227 - 130 seconds (~100x slower). I checked a different batch size: 10_000 - 10 seconds 20_000 - 48 seconds 30_000 - 130 seconds and I was not able to wait for the result of 100_000 entries. Reproducer: {code:java} public class CheckPutAll extends GridCommonAbstractTest { @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); CacheConfiguration ccfg = new CacheConfiguration(DEFAULT_CACHE_NAME); ccfg.setAtomicityMode(TRANSACTIONAL); cfg.setCacheConfiguration(ccfg); return cfg; } @Test public void check() throws Exception { int cnt = 30_000; Map data = new HashMap<>(U.capacity(cnt)); for (int i = 0; i < cnt; i++) data.put(i, i); Ignite node0 = startGrid(0); IgniteCache cache0 = node0.cache(DEFAULT_CACHE_NAME); cache0.putAll(data); } }{code} was: After IGNITE-5227 have been fixed I found significant performance drop in putAll operation. Insertion of 30_000 entries before IGNITE-5227 took ~1 second. After IGNITE-5227 - 130 seconds (~100x slower). I checked a different batch size: 10_000 - 10 seconds 20_000 - 48 seconds 30_000 - 130 seconds and I was not able to wait for the result of 100_000 entries. Reproducer {code:java} public class CheckPutAll extends GridCommonAbstractTest { @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); CacheConfiguration ccfg = new CacheConfiguration(DEFAULT_CACHE_NAME); ccfg.setAtomicityMode(TRANSACTIONAL); cfg.setCacheConfiguration(ccfg); return cfg; } @Test public void check() throws Exception { int cnt = 30_000; Map data = new HashMap<>(U.capacity(cnt)); for (int i = 0; i < cnt; i++) data.put(i, i); Ignite node0 = startGrid(0); IgniteCache cache0 = node0.cache(DEFAULT_CACHE_NAME); cache0.putAll(data); } }{code} > Transactional putAll - significant performance drop on big batches of entries. > ------------------------------------------------------------------------------ > > Key: IGNITE-12087 > URL: https://issues.apache.org/jira/browse/IGNITE-12087 > Project: Ignite > Issue Type: Bug > Components: cache > Reporter: Pavel Pereslegin > Assignee: Eduard Shangareev > Priority: Major > Fix For: 2.8 > > Time Spent: 20m > Remaining Estimate: 0h > > After IGNITE-5227 have been fixed I found significant performance drop in putAll operation. > Insertion of 30_000 entries before IGNITE-5227 took ~1 second. > After IGNITE-5227 - 130 seconds (~100x slower). > I checked a different batch size: > 10_000 - 10 seconds > 20_000 - 48 seconds > 30_000 - 130 seconds > and I was not able to wait for the result of 100_000 entries. > Reproducer: > {code:java} > public class CheckPutAll extends GridCommonAbstractTest { > @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { > IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); > CacheConfiguration ccfg = new CacheConfiguration(DEFAULT_CACHE_NAME); > ccfg.setAtomicityMode(TRANSACTIONAL); > cfg.setCacheConfiguration(ccfg); > return cfg; > } > @Test > public void check() throws Exception { > int cnt = 30_000; > Map data = new HashMap<>(U.capacity(cnt)); > for (int i = 0; i < cnt; i++) > data.put(i, i); > Ignite node0 = startGrid(0); > IgniteCache cache0 = node0.cache(DEFAULT_CACHE_NAME); > cache0.putAll(data); > } > }{code} -- This message was sent by Atlassian Jira (v8.3.2#803003)