flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9138) Enhance BucketingSink to also flush data by time interval
Date Fri, 11 May 2018 22:42:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472768#comment-16472768
] 

ASF GitHub Bot commented on FLINK-9138:
---------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/flink/pull/5860


> Enhance BucketingSink to also flush data by time interval
> ---------------------------------------------------------
>
>                 Key: FLINK-9138
>                 URL: https://issues.apache.org/jira/browse/FLINK-9138
>             Project: Flink
>          Issue Type: Improvement
>          Components: filesystem-connector
>    Affects Versions: 1.4.2
>            Reporter: Narayanan Arunachalam
>            Assignee: Lakshmi Rao
>            Priority: Major
>             Fix For: 1.6.0
>
>
> BucketingSink now supports flushing data to the file system by size limit and by period
of inactivity. It will be useful to also flush data by a specified time period. This way,
the data will be written out when write throughput is low but there is no significant time
period gaps between the writes. This reduces ETA for the data in the file system and should
help move the checkpoints faster as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message