flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-7643) Configure FileSystems only once
Date Fri, 06 Oct 2017 09:28:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16194349#comment-16194349

ASF GitHub Bot commented on FLINK-7643:

Github user StephanEwen commented on the issue:

    Thanks for the comments. Addressing them and merging them...

> Configure FileSystems only once
> -------------------------------
>                 Key: FLINK-7643
>                 URL: https://issues.apache.org/jira/browse/FLINK-7643
>             Project: Flink
>          Issue Type: Bug
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.4.0
>            Reporter: Ufuk Celebi
>            Assignee: Stephan Ewen
> HadoopFileSystem always reloads GlobalConfiguration, which potentially leads to a lot
of noise in the logs, because this happens on each checkpoint.
> Instead, file systems should be configured once upon process startup, when the configuration
is loaded.
> This will also increase efficiency of checkpoints, as it avoids redundant parsing for
each data chunk.

This message was sent by Atlassian JIRA

View raw message