Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2DF9B200BE3 for ; Thu, 22 Dec 2016 11:28:38 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2CC7C160B26; Thu, 22 Dec 2016 10:28:38 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9C53A160B1F for ; Thu, 22 Dec 2016 11:28:37 +0100 (CET) Received: (qmail 74765 invoked by uid 500); 22 Dec 2016 10:28:36 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 74753 invoked by uid 99); 22 Dec 2016 10:28:36 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Dec 2016 10:28:36 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 67022C2256 for ; Thu, 22 Dec 2016 10:28:36 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.973 X-Spam-Level: X-Spam-Status: No, score=0.973 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.972, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id ZIba94zy85r7 for ; Thu, 22 Dec 2016 10:28:34 +0000 (UTC) Received: from mbob.nabble.com (mbob.nabble.com [162.253.133.15]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id EAA0D5F58E for ; Thu, 22 Dec 2016 10:28:33 +0000 (UTC) Received: from static.162.255.23.37.macminivault.com (unknown [162.255.23.37]) by mbob.nabble.com (Postfix) with ESMTP id 00CFF38BFE62 for ; Thu, 22 Dec 2016 02:14:19 -0800 (PST) Date: Thu, 22 Dec 2016 03:28:33 -0700 (MST) From: dkarachentsev To: user@ignite.apache.org Message-ID: <1482402513518-9699.post@n6.nabble.com> In-Reply-To: <1482399930508-9697.post@n6.nabble.com> References: <1482388572566-9692.post@n6.nabble.com> <1482396745638-9695.post@n6.nabble.com> <1482399930508-9697.post@n6.nabble.com> Subject: Re: Improve data loading speed from persistent data storage MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit archived-at: Thu, 22 Dec 2016 10:28:38 -0000 So, most of the time are spent on getting data from DB - 3.5 min. The rest, I think, could be indexing process in cache (you may check it by removing setIndexedTypes()). For speedup you may load data from CSV file, but Ignite doesn't provide such parser, you should implement it by yourself. Of course, if it's suitable to your requirements. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Improve-data-loading-speed-from-persistant-data-storage-tp9692p9699.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.