flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-7767) Avoid loading Hadoop conf dynamically at runtime
Date Thu, 05 Oct 2017 17:45:00 GMT
Stephan Ewen created FLINK-7767:

             Summary: Avoid loading Hadoop conf dynamically at runtime
                 Key: FLINK-7767
                 URL: https://issues.apache.org/jira/browse/FLINK-7767
             Project: Flink
          Issue Type: Improvement
          Components: Streaming Connectors
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.4.0

The bucketing sink dynamically loads the Hadoop configuration in various places.

The result of that configuration is not always predictable, as it tries to automagically discover
the Hadoop config files.

A better approach is to rely on the Flink configuration to find the Hadoop configuration,
or to directly use the Hadoop configuration used by the Hadoop file systems.

This message was sent by Atlassian JIRA

View raw message