kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wang, Gang (JIRA)" <>
Subject [jira] [Created] (KYLIN-3141) Support offset for segment merge
Date Fri, 29 Dec 2017 07:01:00 GMT
Wang, Gang created KYLIN-3141:

             Summary: Support offset for segment merge
                 Key: KYLIN-3141
             Project: Kylin
          Issue Type: New Feature
            Reporter: Wang, Gang
            Priority: Minor

This is a request to add an offset to the Kylin segment merge so as to avoid immediate merge
of segments after a 7 day / 30 day window.

Introducing a delay(offset) would help in 2 things -

a) When auto merge kicks off I have a new segment and my daily incremental segment build script
will fail because they won’t find the last segment.
b) Lot of use cases where I may need to do data backfills for some of the days of the previous
week, but I end up refreshing the whole merged segment instead of a day or two.

This message was sent by Atlassian JIRA

View raw message