hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billie Rinaldi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5941) Slider handles "per.component" for multiple components incorrectly
Date Wed, 30 Nov 2016 15:28:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708876#comment-15708876

Billie Rinaldi commented on YARN-5941:

[~yeshavora], thanks for reporting this bug! [~gsaha], [~jianhe], we have two possible approaches
to fix this. One option is to remove the per.component and per.group configurations after
they have been read. These configurations are used to determine whether a configuration file
should be generated once for the entire application, or once for each component group, or
for each individual component (including uniquely named components). A second option would
be to move these properties to have a conf prefix, so you would specify "conf.app-site.per.component":
"true" or "conf.app-site.per.group": "true". Other properties that already have a conf prefix
are the file type and name, "conf.app-site.type" and "conf.app-site.name". I think I prefer
the second approach.

> Slider handles "per.component" for multiple components incorrectly
> ------------------------------------------------------------------
>                 Key: YARN-5941
>                 URL: https://issues.apache.org/jira/browse/YARN-5941
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Yesha Vora
>            Assignee: Billie Rinaldi
> When multiple components are started by slider and each component should have a different
property file, "per.component" should be set to true for each component.  
> {code:title=component1}
> 'properties': {
> 				'site.app-site.job-builder.class': 'xxx',
> 				'site.app-site.rpc.server.hostname': 'xxx',
> 				'site.app-site.per.component': 'true'
> 			}
> {code}
> {code:title=component2}
> 'properties': {
> 				'site.app-site.job-builder.class.component2': 'yyy',
> 				'site.app-site.rpc.server.hostname.component2': 'yyy',
> 				'site.app-site.per.component': 'true'
> 			}
> {code}
> While doing that, one of the component's property file gets "per.component"="true" in
the slider generated property file. 
> {code:title=property file for component1}
> #Generated by Apache Slider
> #Tue Nov 29 23:20:25 UTC 2016
> per.component=true
> job-builder.class=xxx
> rpc.server.hostname=xxx{code}
> {code:title=property file for component2}
> #Generated by Apache Slider
> #Tue Nov 29 23:20:25 UTC 2016
> job-builder.class.component2=yyy
> rpc.server.hostname.component2=yyy{code}
> "per.component" should not be added in any component's property file. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message