ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Re: Review Request 34451: YARN Service Check job and Oozie job don't run because of whitespace in yarn.scheduler.capacity.root.default-node-label-expression
Date Wed, 20 May 2015 08:13:45 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34451/#review84481
-----------------------------------------------------------



ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml
<https://reviews.apache.org/r/34451/#comment135789>

    Seems like this is caused by not striping the properties patch.
    In that case this is not Yarn 2.3 specific and will reproduce with Yarn 2.2
    
    Alejandro can you please check that. And if so change it in HDP-2.2 rather than overriding
it in HDP-2.3


- Andrew Onischuk


On May 20, 2015, 3:10 a.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34451/
> -----------------------------------------------------------
> 
> (Updated May 20, 2015, 3:10 a.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Jonathan Hurley, Nate
Cole, Sumit Mohanty, and Sid Wagle.
> 
> 
> Bugs: AMBARI-11257
>     https://issues.apache.org/jira/browse/AMBARI-11257
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> STR:
> Create a cluster with Ambari 2.1.0, at build 1638
> Install HDP 2.3.0.0 at build 2030, with HDFS, MR, YARN, ZK, OOZIE
> Run Yarn Service Check
> Run Oozie Service Check
> 
> The Resource Manager UI shows the apps as waiting for AM to schedule them, and eventually
they get killed.
> 
> For Oozie, it is able to launch the MR jobs, but of course, they timeout.
> 
> The problem is that the yarn.scheduler.capacity.root.default-node-label-expression property
is set to " " instead of "", and this behavior changed in HDP 2.3, but works in HDP 2.2 as
well.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml e954af2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml
63d56b0 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/configuration/capacity-scheduler.xml
PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/34451/diff/
> 
> 
> Testing
> -------
> 
> Installed ambari-server
> Patched the file capacity-scheduler.xml
> Deployed a cluster with HDP 2.3 and HDFS, YARN, MR, ZK
> Verified the property change in the configs, and that the YARN Service Check passed.
> 
> ----------------------------------------------------------------------
> Total run:741
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message