phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Taylor (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-3796) LocalIndexes apply the entire batch for each mutation in a batch
Date Wed, 19 Apr 2017 21:30:41 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975561#comment-15975561
] 

James Taylor commented on PHOENIX-3796:
---------------------------------------

[~lhofhansl] - couple of tests failed in MutableIndexFailureIT. I suspect these are test-only
issues, but would be good to check:
{code}
Running org.apache.phoenix.end2end.index.MutableIndexFailureIT
Tests run: 8, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 266.52 sec <<< FAILURE!
- in org.apache.phoenix.end2end.index.MutableIndexFailureIT
testWriteFailureDisablesIndex[MutableIndexFailureIT_transactional=false,localIndex=true,isNamespaceMapped=true](org.apache.phoenix.end2end.index.MutableIndexFailureIT)
 Time elapsed: 20.31 sec  <<< FAILURE!
java.lang.AssertionError
	at org.apache.phoenix.end2end.index.MutableIndexFailureIT.helpTestWriteFailureDisablesIndex(MutableIndexFailureIT.java:218)
	at org.apache.phoenix.end2end.index.MutableIndexFailureIT.testWriteFailureDisablesIndex(MutableIndexFailureIT.java:134)

testWriteFailureDisablesIndex[MutableIndexFailureIT_transactional=false,localIndex=true,isNamespaceMapped=false](org.apache.phoenix.end2end.index.MutableIndexFailureIT)
 Time elapsed: 19.103 sec  <<< FAILURE!
java.lang.AssertionError
	at org.apache.phoenix.end2end.index.MutableIndexFailureIT.helpTestWriteFailureDisablesIndex(MutableIndexFailureIT.java:218)
	at org.apache.phoenix.end2end.index.MutableIndexFailureIT.testWriteFailureDisablesIndex(MutableIndexFailureIT.java:134)
{code}

> LocalIndexes apply the entire batch for each mutation in a batch
> ----------------------------------------------------------------
>
>                 Key: PHOENIX-3796
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3796
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>         Attachments: 3796-4x.txt, PHOENIX-3796-4.x-HBase-0.98.patch, PHOENIX-3796.patch
>
>
> [~mujtabachohan] pointed out an "exponential" increase in update time in the size of
the batch.
> Indeed when I look at the code in Indexer.java I see that for each call to postPut or
postDelete we do insert the entire into the local index. (So for a batch of size 10000 we'd
make 10000 index updates 10000 times)
> [~rajeshbabu]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message