flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mingleizhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9193) Deprecate non-well-defined output methods on DataStream
Date Wed, 18 Apr 2018 01:36:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441743#comment-16441743
] 

mingleizhang commented on FLINK-9193:
-------------------------------------

I agree with [~twalthr] at this point. It would be better adding more comments on those method
like those method can not support consistency guarantees instead of deprecating them. Like
in data analysis for data cleaning, we do need strong consistency guarantees.

> Deprecate non-well-defined output methods on DataStream
> -------------------------------------------------------
>
>                 Key: FLINK-9193
>                 URL: https://issues.apache.org/jira/browse/FLINK-9193
>             Project: Flink
>          Issue Type: Improvement
>          Components: DataStream API
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>            Priority: Major
>             Fix For: 1.5.0
>
>
> Some output methods on {{DataStream}} that write text to files are not safe to use in
a streaming program as they have no consistency guarantees. They are:
>  - {{writeAsText()}}
>  - {{writeAsCsv()}}
>  - {{writeToSocket()}}
>  - {{writeUsingOutputFormat()}}
> Along with those we should also deprecate the {{SinkFunctions}} that they use.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message