hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Bapat (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-22068) Return the last event id dumped as repl status to avoid notification event missing error.
Date Fri, 16 Aug 2019 16:31:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-22068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ashutosh Bapat updated HIVE-22068:
----------------------------------
    Attachment: HIVE-22068.05.patch
        Status: Patch Available  (was: In Progress)

Addressing comments by Sankar.

> Return the last event id dumped as repl status to avoid notification event missing error.
> -----------------------------------------------------------------------------------------
>
>                 Key: HIVE-22068
>                 URL: https://issues.apache.org/jira/browse/HIVE-22068
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ashutosh Bapat
>            Assignee: Ashutosh Bapat
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-22068.01.patch, HIVE-22068.02.patch, HIVE-22068.03.patch, HIVE-22068.04.patch,
HIVE-22068.05.patch
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> In repl load, update the status of target database to the last event dumped so that repl
status returns that and next incremental can specify it as the event from which to start the
dump. WIthout that repl status might return and old event which might cause, older events
to be dumped again and/or a notification event missing error if the older events are cleaned
by the cleaner.
> While at it
>  * Add more logging to DB notification listener cleaner thread
>  ** The time when it considered cleaning, the interval and time before which events were
cleared, the min and max id at that time
>  ** how many events were cleared
>  ** min and max id after the cleaning.
>  * In REPL::START document the starting event, end event if specified and the maximum
number of events, if specified.
>  *



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Mime
View raw message