ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hurley" <jhur...@hortonworks.com>
Subject Re: Review Request 34451: YARN Service Check job and Oozie job don't run because of whitespace in yarn.scheduler.capacity.root.default-node-label-expression
Date Wed, 20 May 2015 15:08:13 GMT


> On May 20, 2015, 4:13 a.m., Andrew Onischuk wrote:
> > ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml,
line 41
> > <https://reviews.apache.org/r/34451/diff/4/?file=964876#file964876line41>
> >
> >     Seems like this is caused by not striping the properties patch.
> >     In that case this is not Yarn 2.3 specific and will reproduce with Yarn 2.2
> >     
> >     Alejandro can you please check that. And if so change it in HDP-2.2 rather than
overriding it in HDP-2.3

I agree; we should correct it in HDP 2.2, but still need trimming logic for existing clusters,
no?


- Jonathan


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34451/#review84481
-----------------------------------------------------------


On May 19, 2015, 11:10 p.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34451/
> -----------------------------------------------------------
> 
> (Updated May 19, 2015, 11:10 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Jonathan Hurley, Nate
Cole, Sumit Mohanty, and Sid Wagle.
> 
> 
> Bugs: AMBARI-11257
>     https://issues.apache.org/jira/browse/AMBARI-11257
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> STR:
> Create a cluster with Ambari 2.1.0, at build 1638
> Install HDP 2.3.0.0 at build 2030, with HDFS, MR, YARN, ZK, OOZIE
> Run Yarn Service Check
> Run Oozie Service Check
> 
> The Resource Manager UI shows the apps as waiting for AM to schedule them, and eventually
they get killed.
> 
> For Oozie, it is able to launch the MR jobs, but of course, they timeout.
> 
> The problem is that the yarn.scheduler.capacity.root.default-node-label-expression property
is set to " " instead of "", and this behavior changed in HDP 2.3, but works in HDP 2.2 as
well.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml e954af2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml
63d56b0 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/configuration/capacity-scheduler.xml
PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/34451/diff/
> 
> 
> Testing
> -------
> 
> Installed ambari-server
> Patched the file capacity-scheduler.xml
> Deployed a cluster with HDP 2.3 and HDFS, YARN, MR, ZK
> Verified the property change in the configs, and that the YARN Service Check passed.
> 
> ----------------------------------------------------------------------
> Total run:741
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message