flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Narayanan Arunachalam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9138) Enhance BucketingSink to also flush data by time interval
Date Thu, 05 Apr 2018 17:25:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427293#comment-16427293

Narayanan Arunachalam commented on FLINK-9138:

[~glaksh100] are you considering the PR for 1.4?

> Enhance BucketingSink to also flush data by time interval
> ---------------------------------------------------------
>                 Key: FLINK-9138
>                 URL: https://issues.apache.org/jira/browse/FLINK-9138
>             Project: Flink
>          Issue Type: Improvement
>          Components: filesystem-connector
>    Affects Versions: 1.4.2
>            Reporter: Narayanan Arunachalam
>            Priority: Major
> BucketingSink now supports flushing data to the file system by size limit and by period
of inactivity. It will be useful to also flush data by a specified time period. This way,
the data will be written out when write throughput is low but there is no significant time
period gaps between the writes. This reduces ETA for the data in the file system and should
help move the checkpoints faster as well.

This message was sent by Atlassian JIRA

View raw message