spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <>
Subject [jira] [Assigned] (SPARK-9782) Add support for YARN application tags running Spark on YARN
Date Mon, 10 Aug 2015 17:35:46 GMT


Apache Spark reassigned SPARK-9782:

    Assignee: Apache Spark

> Add support for YARN application tags running Spark on YARN
> -----------------------------------------------------------
>                 Key: SPARK-9782
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 1.4.1
>            Reporter: Dennis Huo
>            Assignee: Apache Spark
> originally added the new “Application
Tags” feature to YARN to help track the sources of applications among many possible YARN
clients. improved on this to allow a set of
tags to be applied, and for comparison,
added support for MapReduce to easily propagate tags through to YARN via Configuration settings.
> Since the ApplicationSubmissionContext.setApplicationTags method was only added in Hadoop
2.4+, Spark support will invoke the method via reflection the same way other such version-specific
methods are called in elsewhere in the YARN client. Since the usage of tags is generally not
critical to the functionality of older YARN setups, it should be safe to handle NoSuchMethodException
with just a logWarning.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message