flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2380) Allow to configure default FS for file inputs
Date Wed, 20 Jan 2016 13:22:40 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108523#comment-15108523
] 

ASF GitHub Bot commented on FLINK-2380:
---------------------------------------

Github user uce commented on a diff in the pull request:

    https://github.com/apache/flink/pull/1524#discussion_r50252183
  
    --- Diff: docs/setup/config.md ---
    @@ -52,6 +52,14 @@ The configuration files for the TaskManagers can be different, Flink
does not as
     - `parallelism.default`: The default parallelism to use for programs that have no parallelism
specified. (DEFAULT: 1). For setups that have no concurrent jobs running, setting this value
to NumTaskManagers * NumSlotsPerTaskManager will cause the system to use all available execution
resources for the program's execution. **Note**: The default parallelism can be overwriten
for an entire job by calling `setParallelism(int parallelism)` on the `ExecutionEnvironment`
or by passing `-p <parallelism>` to the Flink Command-line frontend. It can be overwritten
for single transformations by calling `setParallelism(int
     parallelism)` on an operator. See the [programming guide]({{site.baseurl}}/apis/programming_guide.html#parallel-execution)
for more information about the parallelism.
     
    +- `fs.default-scheme`: The default filesystem scheme to be used, with the necessary authority
(if needed). 
    +By default, this is set to `file:///` which points to the local filesystem. This means
that the local 
    --- End diff --
    
    Should this be `file:///` (two `/`)?


> Allow to configure default FS for file inputs
> ---------------------------------------------
>
>                 Key: FLINK-2380
>                 URL: https://issues.apache.org/jira/browse/FLINK-2380
>             Project: Flink
>          Issue Type: Improvement
>          Components: JobManager
>    Affects Versions: 0.9, 0.10.0
>            Reporter: Ufuk Celebi
>            Assignee: Kostas
>            Priority: Minor
>              Labels: starter
>             Fix For: 1.0.0
>
>
> File inputs use "file://" as default prefix. A user asked to make this configurable,
e.g. "hdfs://" as default.
> (I'm not sure whether this is already possible or not. I will check and either close
or implement this for the user.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message