phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tulasi P (JIRA)" <>
Subject [jira] [Commented] (PHOENIX-1711) Improve performance of CSV loader
Date Tue, 10 Mar 2015 21:01:38 GMT


Tulasi P commented on PHOENIX-1711:

checked-out version: +4.0.0-incubating-release+
$ git apply PHOENIX-1711_4.0.patch 
PHOENIX-1711_4.0.patch:19: trailing whitespace.
PHOENIX-1711_4.0.patch:123: trailing whitespace.
                    if (constantExpression.getDataType() != null &&  
PHOENIX-1711_4.0.patch:200: trailing whitespace.    
PHOENIX-1711_4.0.patch:204: trailing whitespace.    
PHOENIX-1711_4.0.patch:218: trailing whitespace.    
error: patch failed: phoenix-core/src/main/java/org/apache/phoenix/compile/
error: phoenix-core/src/main/java/org/apache/phoenix/compile/ patch does
not apply
error: patch failed: phoenix-core/src/main/java/org/apache/phoenix/expression/
error: phoenix-core/src/main/java/org/apache/phoenix/expression/ patch
does not apply
error: patch failed: phoenix-core/src/main/java/org/apache/phoenix/jdbc/
error: phoenix-core/src/main/java/org/apache/phoenix/jdbc/ patch does
not apply
error: patch failed: phoenix-core/src/main/java/org/apache/phoenix/mapreduce/
error: phoenix-core/src/main/java/org/apache/phoenix/mapreduce/ patch
does not apply
error: patch failed: phoenix-core/src/main/java/org/apache/phoenix/query/
error: phoenix-core/src/main/java/org/apache/phoenix/query/ patch does
not apply
error: patch failed: phoenix-core/src/main/java/org/apache/phoenix/util/csv/
error: phoenix-core/src/main/java/org/apache/phoenix/util/csv/ patch
does not apply
error: patch failed: phoenix-core/src/test/java/org/apache/phoenix/util/csv/
error: phoenix-core/src/test/java/org/apache/phoenix/util/csv/
patch does not apply

> Improve performance of CSV loader
> ---------------------------------
>                 Key: PHOENIX-1711
>                 URL:
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: James Taylor
>         Attachments: PHOENIX-1711.patch, PHOENIX-1711_4.0.patch
> Here is a break-up of percentage execution time for some of the steps inthe mapper:
> csvParser: 18%
> csvUpsertExecutor.execute(ImmutableList.of(csvRecord)): 39%
> PhoenixRuntime.getUncommittedDataIterator(conn, true): 9%
> ´╗┐while (uncommittedDataIterator.hasNext()): 15%
> Read IO & custom processing: 19%
> See details here:

This message was sent by Atlassian JIRA

View raw message