phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-3796) LocalIndexes apply the entire batch for each mutation in a batch
Date Thu, 20 Apr 2017 00:20:04 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975784#comment-15975784
] 

Lars Hofhansl commented on PHOENIX-3796:
----------------------------------------

Test fails only in master (HBase 1.2.3). 4.x-HBase-1.1 and 4.x-HBase-0.98 are fine. The failure
occurs with or without this patch, and is in caused by moving the index updates into the XXXindispensibly
hook on PHOENIX-3789.

> LocalIndexes apply the entire batch for each mutation in a batch
> ----------------------------------------------------------------
>
>                 Key: PHOENIX-3796
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3796
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>             Fix For: 4.11.0
>
>         Attachments: 3796-4x.txt, PHOENIX-3796-4.x-HBase-0.98.patch, PHOENIX-3796.patch
>
>
> [~mujtabachohan] pointed out an "exponential" increase in update time in the size of
the batch.
> Indeed when I look at the code in Indexer.java I see that for each call to postPut or
postDelete we do insert the entire into the local index. (So for a batch of size 10000 we'd
make 10000 index updates 10000 times)
> [~rajeshbabu]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message