flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-5812) Clean up FileSystem
Date Wed, 15 Feb 2017 17:43:42 GMT
Stephan Ewen created FLINK-5812:
-----------------------------------

             Summary: Clean up FileSystem
                 Key: FLINK-5812
                 URL: https://issues.apache.org/jira/browse/FLINK-5812
             Project: Flink
          Issue Type: Improvement
          Components: Core
    Affects Versions: 1.2.0
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
            Priority: Minor
             Fix For: 1.3.0


The {{FileSystem}} class is overloaded and has methods that are not well supported. I suggest
to do the following cleanups:

  - Pull the safety net into a separate class

  - Use the {{WriteMode}} to indicate overwriting behavior. Right now, the {{FileSystem}}
class defines that enum and never uses it. It feels weird.

  - Remove the {{create(path, overwrite, blocksize, reolication, ...)}} method, which is not
really supported across file system implementations. For HDFS, behavior should be set via
the configuration anyways.

All changes have to be made in a non-API-breaking fashion.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message