hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13335) Add an option to suppress the 'use yarn jar' warning or remove it
Date Wed, 06 Jul 2016 18:56:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364885#comment-15364885
] 

Allen Wittenauer commented on HADOOP-13335:
-------------------------------------------

bq. we are well past the point where we can remove "hadoop jar" or "yarn jar" anytime in the
future.

Totally agree and that was never really on the table.  Long term, hadoop jar == yarn jar functionality-wise,
just not in the 2.x/3.x timeframe.

bq. How about we simply remove the warnings in "hadoop jar" (kind of how we 'undeprecated'
the mapred API) and move forward?

Because users don't understand that YARN_OPTS and HADOOP_OPTS are separate in branch-2.  This
whole situation started a while back because users were changing/setting YARN_OPTS and didn't
understand why hadoop jar blah didn't pick up their changes when they were running YARN jobs.

> Add an option to suppress the 'use yarn jar' warning or remove it
> -----------------------------------------------------------------
>
>                 Key: HADOOP-13335
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13335
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 2.7.0
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: HADOOP-13335.01.patch, HADOOP-13335.02.patch, HADOOP-13335.02_branch-2.patch,
HADOOP-13335.03.patch, HADOOP-13335.03_branch-2.patch, HADOOP-13335.04.patch
>
>
> https://issues.apache.org/jira/browse/HADOOP-11257 added a 'deprecation' warning for
'hadoop jar'.
> hadoop jar is used for a lot more that starting jobs. As an example - hive uses it to
start all it's services (HiveServer2, the hive client, beeline etc).
> Using 'yarn jar' for to start these services / tools doesn't make a lot of sense - there's
no relation to yarn other than requiring the classpath to include yarn libraries.
> I'd propose reverting the changes where this message is printed if YARN variables are
set (leave it in the help message), or adding a mechanism which would allow users to suppress
this WARNING.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message