phoenix-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-5295) Local Index data not replicating for older HBase versions (<= HBase 1.2)
Date Wed, 29 May 2019 20:51:00 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851295#comment-16851295
] 

Hadoop QA commented on PHOENIX-5295:
------------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12970219/PHOENIX-5295.4.14-cdh5.11.v3.patch
  against 4.14-cdh5.11 branch at commit d43bc67dea852b3c9d7c419680d3a1edf8d870c7.
  ATTACHMENT ID: 12970219

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 3 new or modified
tests.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:red}-1 release audit{color}.  The applied patch generated 444 release audit warnings
(more than the master's current 0 warnings).

    {color:green}+1 lineLengths{color}.  The patch does not introduce lines longer than 100

    {color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results: https://builds.apache.org/job/PreCommit-PHOENIX-Build/2611//testReport/
Release audit warnings: https://builds.apache.org/job/PreCommit-PHOENIX-Build/2611//artifact/patchprocess/patchReleaseAuditWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-PHOENIX-Build/2611//console

This message is automatically generated.

> Local Index data not replicating for older HBase versions (<= HBase 1.2)
> ------------------------------------------------------------------------
>
>                 Key: PHOENIX-5295
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5295
>             Project: Phoenix
>          Issue Type: Bug
>         Environment: Branch 4.14-cdh5.11
>            Reporter: Hieu Nguyen
>            Priority: Major
>         Attachments: PHOENIX-5295.4.14-cdh5.11.v1.patch, PHOENIX-5295.4.14-cdh5.11.v1.patch,
PHOENIX-5295.4.14-cdh5.11.v2.patch, PHOENIX-5295.4.14-cdh5.11.v3.patch
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Copied from email thread https://lists.apache.org/thread.html/7ab1d9489eca2ab2b974948fbe60b143fda432ef7dfc603528d460f2@%3Cuser.phoenix.apache.org%3E.
> ---
> We are on Phoenix 4.14-cdh5.11.  We are experiencing an issue where local index data
is not being replicated through HBase replication.  As suggested in a previous email thread
(https://lists.apache.org/thread.html/984fba3c8abd944846deefb3ea285195e0436b9181b9779feac39b59@%3Cuser.phoenix.apache.org%3E),
we have enabled replication for the local indexes (the "L#0" column family on the same table).
 We wrote an integration test to demonstrate this issue on top of 4.14-cdh5.11 branch (https://github.com/hnguyen08/phoenix/commit/3589cb45d941c6909fb3deb5f5abb0f8dfa78dd7).
> After some investigation and debugging, we discovered the following:
> 1. Commit a2f4d7eebec621b58204a9eb78d552f18dcbcf24 (PHOENIX-3827) fixed the issue, but
only in Phoenix for HBase1.3+.  It uses the miniBatchOp.addOperationsFromCP() API introduced
in HBase1.3.  Unfortunately, for the time being, we are stuck on cdh5.11 (based on HBase1.2).
> 2. IndexUtil.writeLocalUpdates() is called in both implementations of IndexCommitter,
both taking skipWAL=true.  It seems like we'd actually want to not skip WAL to ensure that
local-index updates are replicated correctly (since, as mentioned in the above email thread,
"HBase-level replication of the data table will not trigger index updates").  After changing
the skipWAL flag to false, the above integration test passes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message