Return-Path: X-Original-To: apmail-phoenix-dev-archive@minotaur.apache.org Delivered-To: apmail-phoenix-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 539AC17476 for ; Tue, 10 Mar 2015 19:27:42 +0000 (UTC) Received: (qmail 47642 invoked by uid 500); 10 Mar 2015 19:21:02 -0000 Delivered-To: apmail-phoenix-dev-archive@phoenix.apache.org Received: (qmail 47594 invoked by uid 500); 10 Mar 2015 19:21:02 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 47583 invoked by uid 99); 10 Mar 2015 19:21:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Mar 2015 19:21:02 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Tue, 10 Mar 2015 19:20:41 +0000 Received: (qmail 43870 invoked by uid 99); 10 Mar 2015 19:20:38 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Mar 2015 19:20:38 +0000 Date: Tue, 10 Mar 2015 19:20:38 +0000 (UTC) From: "James Taylor (JIRA)" To: dev@phoenix.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (PHOENIX-1711) Improve performance of CSV loader MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PHOENIX-1711?page=3Dcom.atlass= ian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor updated PHOENIX-1711: ---------------------------------- Attachment: PHOENIX-1711_4.0.patch Try applying this patch to the latest on 4.0 branch like this: {code} git apply PHOENIX-1711_4.0.patch {code} Then you'll need to run mvn package followed by replacing you client and se= rver jars with the ones build by the package command in phoenix-assembly/ta= rget/ > Improve performance of CSV loader > --------------------------------- > > Key: PHOENIX-1711 > URL: https://issues.apache.org/jira/browse/PHOENIX-1711 > Project: Phoenix > Issue Type: Bug > Reporter: James Taylor > Attachments: PHOENIX-1711.patch, PHOENIX-1711_4.0.patch > > > Here is a break-up of percentage execution time for some of the steps int= he mapper: > csvParser: 18% > csvUpsertExecutor.execute(ImmutableList.of(csvRecord)): 39% > PhoenixRuntime.getUncommittedDataIterator(conn, true): 9% > =EF=BB=BFwhile (uncommittedDataIterator.hasNext()): 15% > Read IO & custom processing: 19% > See details here: http://s.apache.org/6rl -- This message was sent by Atlassian JIRA (v6.3.4#6332)