flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aljoscha Krettek (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1722) Streaming not respecting FinalizeOnMaster for output formats
Date Mon, 03 Apr 2017 12:16:41 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953377#comment-15953377

Aljoscha Krettek commented on FLINK-1722:

[~rmetzger] I don't think we will fix this. We can either simply close the issue or add a
check to {{OutputFormatSinkFunction}} that disallows {{FinalizeOnMaster}} {{OutputFormats}}.

> Streaming not respecting FinalizeOnMaster for output formats
> ------------------------------------------------------------
>                 Key: FLINK-1722
>                 URL: https://issues.apache.org/jira/browse/FLINK-1722
>             Project: Flink
>          Issue Type: Bug
>          Components: DataStream API
>            Reporter: Robert Metzger
> The Hadoop output formats execute a process in the end to move the produced files from
a temp directory to the final location.
> The batch API is annotating output formats that execute something in the end with the
{{FinalizeOnMaster}} interface.
> The streaming component is not respecting this interface. Hence, HadoopOutputFormats
aren't writing their final data into the desired destination.

This message was sent by Atlassian JIRA

View raw message