hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sankar Hariappan (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-17681) Need to log bootstrap dump progress state property to HS2 logs.
Date Wed, 04 Oct 2017 09:24:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191036#comment-16191036
] 

Sankar Hariappan edited comment on HIVE-17681 at 10/4/17 9:23 AM:
------------------------------------------------------------------

Added work around as follows to [https://cwiki.apache.org/confluence/display/Hive/HiveReplicationv2Development#HiveReplicationv2Development-REPLDUMP]
section.

{quote}When bootstrap dump is in progress, it blocks rename table/partition operations on
any tables of the dumped database and throws HiveException. Once bootstrap dump is completed,
rename operations are enabled and will work as normal. If HiveServer2 crashes when bootstrap
dump in progress, then rename operations will continue to throw HiveException even after HiveServer2
is restored with no REPL DUMP in progress. This abnormal state should be manually fixed using
following work around. 
Look up the HiveServer logs for below pair of log messages.
REPL DUMP:: Set property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>,
Value: ACTIVE
REPL DUMP:: Reset property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>
If Reset property log is not found for the corresponding Set property log, then user need
to manually reset the database property <bootstrap.dump.state.xxxx> with value as "IDLE"
using ALTER DATABASE command.{quote}


was (Author: sankarh):
Added work around as follows to [https://cwiki.apache.org/confluence/display/Hive/HiveReplicationv2Development#HiveReplicationv2Development-REPLDUMP]
section.

bq. When bootstrap dump is in progress, it blocks rename table/partition operations on any
tables of the dumped database and throws HiveException. Once bootstrap dump is completed,
rename operations are enabled and will work as normal. If HiveServer2 crashes when bootstrap
dump in progress, then rename operations will continue to throw HiveException even after HiveServer2
is restored with no REPL DUMP in progress. This abnormal state should be manually fixed using
following work around. 
bq. Look up the HiveServer logs for below pair of log messages.
bq. REPL DUMP:: Set property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>,
Value: ACTIVE
bq. REPL DUMP:: Reset property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>
bq. If Reset property log is not found for the corresponding Set property log, then user need
to manually reset the database property <bootstrap.dump.state.xxxx> with value as "IDLE"
using ALTER DATABASE command.

> Need to log bootstrap dump progress state property to HS2 logs.
> ---------------------------------------------------------------
>
>                 Key: HIVE-17681
>                 URL: https://issues.apache.org/jira/browse/HIVE-17681
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, repl
>    Affects Versions: 3.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>              Labels: DDL, DR, replication
>             Fix For: 3.0.0
>
>
> Currently, rename is disabled if bootstrap dump in progress. This is achieved by setting
a "ACTIVE" flag in database properties which is referred by rename operation. If HiveServer2
crashes when dump in progress, then this flag is not unset (to IDLE state) which make the
rename operation disabled for ever. 
> User need to manually enable rename in this scenario. So, need to log the property name
associated with bootstrap dump which was in progress when HS2 crashes. Using this, user will
reset this property of the database to enable rename again.
> Also, need document update for the same.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message