flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-7767) Avoid loading Hadoop conf dynamically at runtime
Date Thu, 05 Oct 2017 17:45:00 GMT
Stephan Ewen created FLINK-7767:
-----------------------------------

             Summary: Avoid loading Hadoop conf dynamically at runtime
                 Key: FLINK-7767
                 URL: https://issues.apache.org/jira/browse/FLINK-7767
             Project: Flink
          Issue Type: Improvement
          Components: Streaming Connectors
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.4.0


The bucketing sink dynamically loads the Hadoop configuration in various places.

The result of that configuration is not always predictable, as it tries to automagically discover
the Hadoop config files.

A better approach is to rely on the Flink configuration to find the Hadoop configuration,
or to directly use the Hadoop configuration used by the Hadoop file systems.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message