flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2823) YARN client should report a proper exception if Hadoop Env variables are not set
Date Wed, 07 Oct 2015 10:16:26 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14946630#comment-14946630
] 

Maximilian Michels commented on FLINK-2823:
-------------------------------------------

I think MapR FS comes with its own file system schema {{maprfs://}}. {{file://}} should really
indicate that the setup is not correct.

Only checking the environment variables won't cover all cases. You can, for instance, configure
Hadoop using resource files in the class path. 

> YARN client should report a proper exception if Hadoop Env variables are not set
> --------------------------------------------------------------------------------
>
>                 Key: FLINK-2823
>                 URL: https://issues.apache.org/jira/browse/FLINK-2823
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN Client
>    Affects Versions: 0.10
>            Reporter: Stephan Ewen
>             Fix For: 0.10
>
>
> The important variables are {{HADOOP_HOME}} and {{HADOOP_CONF_DIR}}.
> If none of the two environment variables are set, the YARN client does not pick the correct
settings / file system to successfully deploy a job.
> The YARN client should throw a good exception. Right now, this requires some tricky debugging
to find the cause of the problem.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message