kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wang, Gang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-3141) Support offset for segment merge
Date Fri, 29 Dec 2017 07:01:00 GMT
Wang, Gang created KYLIN-3141:
---------------------------------

             Summary: Support offset for segment merge
                 Key: KYLIN-3141
                 URL: https://issues.apache.org/jira/browse/KYLIN-3141
             Project: Kylin
          Issue Type: New Feature
            Reporter: Wang, Gang
            Priority: Minor


This is a request to add an offset to the Kylin segment merge so as to avoid immediate merge
of segments after a 7 day / 30 day window.

Introducing a delay(offset) would help in 2 things -

a) When auto merge kicks off I have a new segment and my daily incremental segment build script
will fail because they won’t find the last segment.
b) Lot of use cases where I may need to do data backfills for some of the days of the previous
week, but I end up refreshing the whole merged segment instead of a day or two.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message