phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajeshbabu Chintaguntla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-3496) Figure out why LocalIndexIT#testLocalIndexRoundTrip is flapping
Date Fri, 19 May 2017 17:28:04 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017702#comment-16017702
] 

Rajeshbabu Chintaguntla commented on PHOENIX-3496:
--------------------------------------------------

[~samarthjain] When we create local index we add column family L#0 to table by modifying the
table. We are going by online schema update and polling whether table is modified or not.
But in HBase first new descriptor added to list of table descriptors first then reopen the
regions. So while building the local index we might open scanner on old region not able see
the column family. 
[~jamestaylor] As a fix we might need to go by disable,modify and enable table while creating
local index? Checking with HBase team whether the behaviour can be changed in HBase.

> Figure out why LocalIndexIT#testLocalIndexRoundTrip is flapping
> ---------------------------------------------------------------
>
>                 Key: PHOENIX-3496
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3496
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Samarth Jain
>            Assignee: Rajeshbabu Chintaguntla
>
> The test has been passing consistently on the "4.*-HBase-0.98" branches. However, it
has been flapping pretty regularly on the master branch and the "4.*-HBase-1.1" branches.
> I ran the test locally a few number of times and it did flap. I did notice that in cases
where it failed, the logs also had a RegionOpeningException. 
> For example:
> {code}
> org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region TEST_TABLET000060,\x07\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00,1479426366023.04f765e5d906bbd193b38a9f8c20e478.
is opening on localhost,55599,1479426313446
> 	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2908)
> 	at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1053)
> 	at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2385)
> 	at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> 	at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> 	at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> 	at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
> 	at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}
> And the test failure:
> {code}
> ava.util.concurrent.ExecutionException: org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException:
Column family L#0 does not exist in region TEST_TABLET000060,\x09\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00,1479426366023.47319064397e6e25e8e7cc992ebce3e6.
in table 'TEST_TABLET000060', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.phoenix.coprocessor.ScanRegionObserver|805306366|',
coprocessor$2 => '|org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver|805306366|',
coprocessor$3 => '|org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver|805306366|',
coprocessor$4 => '|org.apache.phoenix.coprocessor.ServerCachingEndpointImpl|805306366|',
coprocessor$5 => '|org.apache.phoenix.hbase.index.Indexer|805306366|index.builder=org.apache.phoenix.index.PhoenixIndexBuilder,org.apache.hadoop.hbase.index.codec.class=org.apache.phoenix.index.PhoenixIndexCodec'},
{NAME => '0', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW', REPLICATION_SCOPE
=> '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS
=> '0', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkFamily(HRegion.java:7649)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2543)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2527)
> 	at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2406)
> 	at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> 	at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> 	at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> 	at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
> 	at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
> 	at java.lang.Thread.run(Thread.java:745)
> 	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> 	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
> 	at org.apache.phoenix.end2end.index.LocalIndexIT.testLocalIndexRoundTrip(LocalIndexIT.java:166)
> {code}
> [~rajeshbabu], can you please take a look.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message