flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9750) Create new StreamingFileSink that works on Flink's FileSystem abstraction
Date Wed, 11 Jul 2018 21:00:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540654#comment-16540654
] 

ASF GitHub Bot commented on FLINK-9750:
---------------------------------------

Github user kl0u commented on the issue:

    https://github.com/apache/flink/pull/6281
  
    Hi @aljoscha and @StephanEwen . I have updated the PR, please have a look.


> Create new StreamingFileSink that works on Flink's FileSystem abstraction
> -------------------------------------------------------------------------
>
>                 Key: FLINK-9750
>                 URL: https://issues.apache.org/jira/browse/FLINK-9750
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Streaming Connectors
>            Reporter: Stephan Ewen
>            Assignee: Kostas Kloudas
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.6.0
>
>
> Using Flink's own file system abstraction means that we can add additional streaming/checkpointing
related behavior.
> In addition, the new StreamingFileSink should only rely on internal checkpointed state
what files are possibly in progress or need to roll over, never assume enumeration of files
in the file system.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message