phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-3796) LocalIndexes apply the entire batch for each mutation in a batch
Date Thu, 20 Apr 2017 00:11:04 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975774#comment-15975774
] 

Lars Hofhansl commented on PHOENIX-3796:
----------------------------------------

Yep. In fact it fails since PHOENIX-3789 (at least in master).

OK... So I am going to commit this one, and file a new jira on the test failure.

> LocalIndexes apply the entire batch for each mutation in a batch
> ----------------------------------------------------------------
>
>                 Key: PHOENIX-3796
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3796
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>         Attachments: 3796-4x.txt, PHOENIX-3796-4.x-HBase-0.98.patch, PHOENIX-3796.patch
>
>
> [~mujtabachohan] pointed out an "exponential" increase in update time in the size of
the batch.
> Indeed when I look at the code in Indexer.java I see that for each call to postPut or
postDelete we do insert the entire into the local index. (So for a batch of size 10000 we'd
make 10000 index updates 10000 times)
> [~rajeshbabu]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message