hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13335) Add an option to suppress the 'use yarn jar' warning or remove it
Date Tue, 05 Jul 2016 20:20:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363150#comment-15363150
] 

Allen Wittenauer commented on HADOOP-13335:
-------------------------------------------

bq. If I'm not mistaken yarn-config.sh imports hadoop-config.sh - so parameters like HADOOP_USER_CLASSPATH_FIRST
etc will be respected. YARN_CLASSPATH_FIRST is handled after building the hadoop classpath.

But hive doesn't call yarn, it uses hadoop. hadoop does not import yarn-config.sh, which is
where yarn configuration parameters are expected to be located. YARN\_USER\_CLASSPATH is not
handled or likely defined *at all*.  So none of those settings will be defined.

> Add an option to suppress the 'use yarn jar' warning or remove it
> -----------------------------------------------------------------
>
>                 Key: HADOOP-13335
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13335
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 2.7.0
>            Reporter: Siddharth Seth
>         Attachments: HADOOP-13335.01.patch
>
>
> https://issues.apache.org/jira/browse/HADOOP-11257 added a 'deprecation' warning for
'hadoop jar'.
> hadoop jar is used for a lot more that starting jobs. As an example - hive uses it to
start all it's services (HiveServer2, the hive client, beeline etc).
> Using 'yarn jar' for to start these services / tools doesn't make a lot of sense - there's
no relation to yarn other than requiring the classpath to include yarn libraries.
> I'd propose reverting the changes where this message is printed if YARN variables are
set (leave it in the help message), or adding a mechanism which would allow users to suppress
this WARNING.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message