Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C6117200C92 for ; Mon, 12 Jun 2017 12:46:07 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id C4520160BD9; Mon, 12 Jun 2017 10:46:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3C56E160BD6 for ; Mon, 12 Jun 2017 12:46:07 +0200 (CEST) Received: (qmail 73737 invoked by uid 500); 12 Jun 2017 10:46:06 -0000 Mailing-List: contact issues-help@carbondata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.apache.org Delivered-To: mailing list issues@carbondata.apache.org Received: (qmail 73728 invoked by uid 99); 12 Jun 2017 10:46:06 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Jun 2017 10:46:06 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id CFC12E000B; Mon, 12 Jun 2017 10:46:04 +0000 (UTC) From: kumarvishal09 To: issues@carbondata.apache.org Reply-To: issues@carbondata.apache.org Message-ID: Subject: [GitHub] carbondata pull request #1019: [CARBONDATA-1156]Improve IUD performance and ... Content-Type: text/plain Date: Mon, 12 Jun 2017 10:46:04 +0000 (UTC) archived-at: Mon, 12 Jun 2017 10:46:08 -0000 GitHub user kumarvishal09 opened a pull request: https://github.com/apache/carbondata/pull/1019 [CARBONDATA-1156]Improve IUD performance and fixed synchronization issue Delete delta file loading is taking more time as it is read for blocklet level. Now added code to read block level. In current IUD design delete delta files are getting listed for each block in executor level in case of parallel query and iud operation it may give wrong result. Now passing delete delta information from driver to executor You can merge this pull request into a Git repository by running: $ git pull https://github.com/kumarvishal09/incubator-carbondata IUDPerformanceImprovement Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1019.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1019 ---- commit 60cfc66fe1f2de4cc3c2395a4dd479abb2a602f4 Author: kumarvishal Date: 2017-06-12T10:36:24Z Fixed Syncronization issue and improve IUD performance ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---