phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-3796) LocalIndexes apply the entire batch for each mutation in a batch
Date Wed, 19 Apr 2017 17:19:41 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975117#comment-15975117
] 

Andrew Purtell commented on PHOENIX-3796:
-----------------------------------------

bq. So moving local index writes to postBatchMutateIndispensably hook makes very sense(After
HBASE-15600 we don't need this at all). 

I see HBASE-15600 is in 1.3 and up.

Does it make sense to make improvements on Phoenix master branch that take advantage of such
changes? Would it fine to say master aka Phoenix 5 is only compatible with HBase 1.3 and up?
If so I suggest taking all available steps to improve the implementation of indexes. 

[~rajeshbabu]
[~jamestaylor]
[~lhofhansl]

> LocalIndexes apply the entire batch for each mutation in a batch
> ----------------------------------------------------------------
>
>                 Key: PHOENIX-3796
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3796
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Lars Hofhansl
>         Attachments: 3796-4x.txt
>
>
> [~mujtabachohan] pointed out an "exponential" increase in update time in the size of
the batch.
> Indeed when I look at the code in Indexer.java I see that for each call to postPut or
postDelete we do insert the entire into the local index. (So for a batch of size 10000 we'd
make 10000 index updates 10000 times)
> [~rajeshbabu]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message