flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2380) Allow to configure default FS for file inputs
Date Fri, 12 Feb 2016 11:34:18 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144483#comment-15144483
] 

ASF GitHub Bot commented on FLINK-2380:
---------------------------------------

Github user rmetzger commented on the pull request:

    https://github.com/apache/flink/pull/1524#issuecomment-183288223
  
    Thank you.
    
    - ` ./bin/yarn-session.sh -tm 1024 -n 7 -s 2 -Dfs.default-scheme=hdfs:///` is now working
    - Setting the fs.default-scheme to `thisIsWrong` and trying to read from `/user/robert/trashaa`
leads to:
    ```
    Caused by: java.io.IOException: The URI '/user/robert/trashaa' is invalid. Hint: Did you
specify only the PATH to your file (without the scheme) but forgot the initial slash (/) in
the beginning???
    ```
    I don't think putting three question marks there is a good idea. I think it implicates
that the user is too stupid to properly specify a file path.
    And I would like to see the default scheme there. Right now, its quite hard to see what's
wrong.
    
    the error reporting for the default scheme: `thisIsWrong:///` and the path `/user/robert/trashaa`
is good again: 
    ```
    Caused by: java.io.IOException: No file system found with scheme thisIsWrong, referenced
in file URI 'thisIsWrong:/user/robert/trashaaa'.
    ```
    I would expect a similar error reporting for `fs.default-scheme=thisIsWrong`
    
    
    
    



> Allow to configure default FS for file inputs
> ---------------------------------------------
>
>                 Key: FLINK-2380
>                 URL: https://issues.apache.org/jira/browse/FLINK-2380
>             Project: Flink
>          Issue Type: Improvement
>          Components: JobManager
>    Affects Versions: 0.9, 0.10.0
>            Reporter: Ufuk Celebi
>            Assignee: Klou
>            Priority: Minor
>              Labels: starter
>             Fix For: 1.0.0
>
>
> File inputs use "file://" as default prefix. A user asked to make this configurable,
e.g. "hdfs://" as default.
> (I'm not sure whether this is already possible or not. I will check and either close
or implement this for the user.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message