phoenix-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <>
Subject [jira] [Commented] (PHOENIX-5295) Local Index data not replicating for older HBase versions (<= HBase 1.2)
Date Wed, 29 May 2019 20:51:00 GMT


Hadoop QA commented on PHOENIX-5295:

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment
  against 4.14-cdh5.11 branch at commit d43bc67dea852b3c9d7c419680d3a1edf8d870c7.
  ATTACHMENT ID: 12970219

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 3 new or modified

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:red}-1 release audit{color}.  The applied patch generated 444 release audit warnings
(more than the master's current 0 warnings).

    {color:green}+1 lineLengths{color}.  The patch does not introduce lines longer than 100

    {color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results:
Release audit warnings:
Console output:

This message is automatically generated.

> Local Index data not replicating for older HBase versions (<= HBase 1.2)
> ------------------------------------------------------------------------
>                 Key: PHOENIX-5295
>                 URL:
>             Project: Phoenix
>          Issue Type: Bug
>         Environment: Branch 4.14-cdh5.11
>            Reporter: Hieu Nguyen
>            Priority: Major
>         Attachments: PHOENIX-5295.4.14-cdh5.11.v1.patch, PHOENIX-5295.4.14-cdh5.11.v1.patch,
PHOENIX-5295.4.14-cdh5.11.v2.patch, PHOENIX-5295.4.14-cdh5.11.v3.patch
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
> Copied from email thread
> ---
> We are on Phoenix 4.14-cdh5.11.  We are experiencing an issue where local index data
is not being replicated through HBase replication.  As suggested in a previous email thread
we have enabled replication for the local indexes (the "L#0" column family on the same table).
 We wrote an integration test to demonstrate this issue on top of 4.14-cdh5.11 branch (
> After some investigation and debugging, we discovered the following:
> 1. Commit a2f4d7eebec621b58204a9eb78d552f18dcbcf24 (PHOENIX-3827) fixed the issue, but
only in Phoenix for HBase1.3+.  It uses the miniBatchOp.addOperationsFromCP() API introduced
in HBase1.3.  Unfortunately, for the time being, we are stuck on cdh5.11 (based on HBase1.2).
> 2. IndexUtil.writeLocalUpdates() is called in both implementations of IndexCommitter,
both taking skipWAL=true.  It seems like we'd actually want to not skip WAL to ensure that
local-index updates are replicated correctly (since, as mentioned in the above email thread,
"HBase-level replication of the data table will not trigger index updates").  After changing
the skipWAL flag to false, the above integration test passes.

This message was sent by Atlassian JIRA

View raw message