phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "JeongMin Ju (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-3977) Region is not closed when moving region or balancing while writing to table with local index
Date Wed, 28 Jun 2017 00:35:00 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065726#comment-16065726
] 

JeongMin Ju commented on PHOENIX-3977:
--------------------------------------

Hi.
This problem is related only to the local index.
The global index problem can be solved by increasing hbase.regionserver.executor.openregion.threads,
but this is not the case.
You can see this phenomenon by writing to a table with a local index and moving any region.
The problem with the global index is that the region is pending open and now the region is
in the pending close state.

!screenshot-1.png!

> Region is not closed when moving region or balancing while writing to table with local
index
> --------------------------------------------------------------------------------------------
>
>                 Key: PHOENIX-3977
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3977
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.10.0
>            Reporter: JeongMin Ju
>         Attachments: screenshot-1.png
>
>
> Region is not closed when moving region or balancing while writing to table with local
index.
> If the regionserver is forcibly killed and restart and then balancing is performed during
write operation perform using YCSB. The region is not moved properly, so it becomes jammed.
> This is also true when moving a specific region.
> {panel:title=RegionServer1}
> 2017-06-26 17:18:49,096 INFO org.apache.phoenix.hbase.index.util.IndexManagementUtil:
Rethrowing org.apache.hadoop.hbase.DoNotRetryIOException: ERROR 2008 (INT10): ERROR 2008 (INT10):
Unable to find cached index metadata.  key=-4998016164816556219 region=PHOENIX_TABLE,&,1498464285648.df3f3da32306361ce5e38e5193f5e5d6.host=juke-cdh-36f531b4.s2.krane.9rum.cc,60020,1498464965204
Index update failed
> 2017-06-26 17:18:49,531 INFO org.apache.phoenix.hbase.index.util.IndexManagementUtil:
Rethrowing org.apache.hadoop.hbase.DoNotRetryIOException: ERROR 2008 (INT10): ERROR 2008 (INT10):
Unable to find cached index metadata.  key=6036765365681157624 region=PHOENIX_TABLE,&,1498464285648.df3f3da32306361ce5e38e5193f5e5d6.host=juke-cdh-36f531b4.s2.krane.9rum.cc,60020,1498464965204
Index update failed
> 2017-06-26 17:18:49,536 INFO org.apache.phoenix.hbase.index.util.IndexManagementUtil:
Rethrowing org.apache.hadoop.hbase.DoNotRetryIOException: ERROR 2008 (INT10): ERROR 2008 (INT10):
Unable to find cached index metadata.  key=-428088766346522675 region=PHOENIX_TABLE,&,1498464285648.df3f3da32306361ce5e38e5193f5e5d6.host=juke-cdh-36f531b4.s2.krane.9rum.cc,60020,1498464965204
Index update failed
> {panel}
> At other regionserver
> {panel:title=RegionServer2}
> 2017-06-26 17:19:49,755 INFO org.apache.hadoop.hbase.client.AsyncProcess: #1476, waiting
for 62  actions to finish on table: PHOENIX_TABLE
> 2017-06-26 17:19:49,755 INFO org.apache.hadoop.hbase.client.AsyncProcess: #1476, waiting
for 27  actions to finish on table: PHOENIX_TABLE
> 2017-06-26 17:19:49,755 INFO org.apache.hadoop.hbase.client.AsyncProcess: #1476, waiting
for 52  actions to finish on table: PHOENIX_TABLE
> {panel}
> phoenix.coprocessor.maxServerCacheTimeToLiveMs & phoenix.coprocessor.maxMetaDataCacheSize
was not effected.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message