hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13335) Add an option to suppress the 'use yarn jar' warning or remove it
Date Wed, 06 Jul 2016 00:07:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363520#comment-15363520
] 

Allen Wittenauer commented on HADOOP-13335:
-------------------------------------------

I'm pretty much -1 on changing this in trunk.  The warning is there for a reason.  If 3rd
parties want to explicitly go against that advice, then they just need to unset the given
YARN env vars prior to launching hadoop jar. Unsetting those prior to launching hadoop jar
has no impact since they aren't referenced at all in that code path.  Therefore, no functionality
is lost.  This is also much simpler than adding Yet Another Configuration Variable and puts
the onus on the caller to do whatever they want to do without putting more code maintenance
on Hadoop.

> Add an option to suppress the 'use yarn jar' warning or remove it
> -----------------------------------------------------------------
>
>                 Key: HADOOP-13335
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13335
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 2.7.0
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: HADOOP-13335.01.patch, HADOOP-13335.02.patch, HADOOP-13335.02_branch-2.patch,
HADOOP-13335.03.patch, HADOOP-13335.03_branch-2.patch, HADOOP-13335.04.patch
>
>
> https://issues.apache.org/jira/browse/HADOOP-11257 added a 'deprecation' warning for
'hadoop jar'.
> hadoop jar is used for a lot more that starting jobs. As an example - hive uses it to
start all it's services (HiveServer2, the hive client, beeline etc).
> Using 'yarn jar' for to start these services / tools doesn't make a lot of sense - there's
no relation to yarn other than requiring the classpath to include yarn libraries.
> I'd propose reverting the changes where this message is printed if YARN variables are
set (leave it in the help message), or adding a mechanism which would allow users to suppress
this WARNING.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message