flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kostas Kloudas (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3956) Make FileInputFormats in Streaming independent from the Configuration object
Date Mon, 23 May 2016 13:25:12 GMT
Kostas Kloudas created FLINK-3956:
-------------------------------------

             Summary: Make FileInputFormats in Streaming independent from the Configuration
object
                 Key: FLINK-3956
                 URL: https://issues.apache.org/jira/browse/FLINK-3956
             Project: Flink
          Issue Type: Bug
          Components: Streaming
            Reporter: Kostas Kloudas
            Assignee: Kostas Kloudas


Currently many input file input formats rely on a user specified Configuration object for
their correct configuration. As an example, the DelimitedInputFormat can take its delimiter
character from this object. 

This is happening for legacy reasons, and does not work in the streaming codebase. In streaming,
the user-specified configuration object is over-written at the TaskManagers by a new Configuration
object.

This issue aims at solving this by refactoring current file input formats to be 
able to set their parameters through setters.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message