phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mujtaba Chohan (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch
Date Wed, 17 May 2017 19:16:04 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16014642#comment-16014642
] 

Mujtaba Chohan edited comment on PHOENIX-3853 at 5/17/17 7:15 PM:
------------------------------------------------------------------

Performance for *mutable* local index. Again this is with HBase 1.3.1 with head of Phoenix
4.x with/without PHOENIX-3827 v2/v3 patch applied and using the same schema.

!batch_mutable.png!


| Batch Size | Local Index with PHOENIX-3827_v2/3 patch | Local Index | Global | 
| 100        | 0.025                                    | 0.03        | 0.03   | 
| 1000       | 0.35                                     | 0.3         | 0.25   | 
| 10000      | 11                                       | 2.5         | 2.3    | 
| 12500      | 18                                       | 3.1         | 3.1    | 
| 15000      | 25                                       | 3.2         | 3.2    | 


was (Author: mujtabachohan):
Performance for *mutable* local index. Again this is with HBase 1.3.1 with head of Phoenix
4.x with/without PHOENIX-3827 v2/v3 patch applied and using the same schema.

!batch_mutable.png!


| Batch Size | Local Index with PHOENIX-3827_v2 patch | Local Index without PHOENIX-3827_v2.patch
| Global | 
| 100        | 0.02                                   | 0.03                             
        | 0.013  |  
| 1000       | 0.3                                    | 0.3                              
        | 0.13   |  
| 10000      | 4.3                                    | 2.6                              
        | 1.3    |  
| 12500      | 8.1                                    | 3                                
        | 1.6    |  
| 15000      | 13.3                                   | 3.1                              
        | 1.9    |  


> Local Index - Writes to local index are twice as slow as global and get exponentially
slower with PHOENIX-3827_v2 patch
> -----------------------------------------------------------------------------------------------------------------------
>
>                 Key: PHOENIX-3853
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3853
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.10.0
>         Environment: HBase 1.3.1 4GB heap in local mode
>            Reporter: Mujtaba Chohan
>             Fix For: 4.11.0
>
>         Attachments: batch_mutable.png, batch_time.png
>
>
> HBase 1.3.1 with head of Phoenix 4.x with/without PHOENIX-3827 v2 patch applied. This
is with immutable non-covered local/global index on a single column with varying batch size
when writing data to base table plus index.
> !batch_time.png!
> | Batch Size | Local Index with PHOENIX-3827_v2 patch (sec)| Local Index without PHOENIX-3827_v2.patch
(sec)| Global (sec)| 
> | 100 | 0.02 | 0.03 | 0.013 | 
> | 1000 | 0.3 | 0.3 | 0.13 | 
> | 10000 | 4.3 | 2.6 | 1.3 | 
> | 12500 | 8.1 | 3 | 1.6 | 
> | 15000 | 13.3 | 3.1 | 1.9 | 
> Schema and index
> {noformat}
> CREATE TABLE IF NOT EXISTS T (OID CHAR(15) NOT NULL, PKP CHAR(3) NOT NULL, PIH CHAR(15)
NOT NULL, FD DATE NOT NULL, SB CHAR(15) NOT NULL, BJ CHAR(15), JR VARCHAR, FIELD VARCHAR,
YM VARCHAR, WN VARCHAR, LG VARCHAR, XHJ VARCHAR, HF VARCHAR, GA VARCHAR, MX VARCHAR, NZ DECIMAL,
JV DECIMAL, AG DATE, KV DATE, JK VARCHAR, DK VARCHAR, EU DATE, OE VARCHAR, DV INTEGER, IK
VARCHAR CONSTRAINT PK PRIMARY KEY ( OID, PKP, PIH, FD DESC, SB )) VERSIONS=1,IMMUTABLE_ROWS=true
> CREATE INDEX IF NOT EXISTS IDXT ON T (JV)
> {noformat}
> Data CSV
> https://expirebox.com/download/1cea73af1831b5193f0539d6e3442292.html
> [~rajeshbabu], [~lhofhansl], [~jamestaylor]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message