ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitro Lisnichenko" <dlysniche...@hortonworks.com>
Subject Re: Review Request 31212: Kafka & Spark service checks fail intermittently on kerberized cluster
Date Mon, 23 Feb 2015 11:42:58 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31212/#review73547
-----------------------------------------------------------

Ship it!


Ship It!

- Dmitro Lisnichenko


On Feb. 20, 2015, 11:52 p.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31212/
> -----------------------------------------------------------
> 
> (Updated Feb. 20, 2015, 11:52 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Jonathan Hurley, Nate
Cole, and Srimanth Gunturi.
> 
> 
> Bugs: AMBARI-9717
>     https://issues.apache.org/jira/browse/AMBARI-9717
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Kafka and Spark service checks will fail intermittently.
> 
> Kafka runs a command to create a topic, which is expected to fail after being ran once,
and then greps the output to make sure that the topic was created or already existed. The
problem is that this will only work the first time, since it was not ignorring stderr. Instead,
just call the command, and perform a regex match on the output.
> 
> Spark was not kiniting before doing its service check. I presume it worked sometimes
if some credenetial had already been cached.
> 
> 
> Diffs
> -----
> 
>   ambari-common/src/main/python/resource_management/libraries/functions/validate.py PRE-CREATION

>   ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py
80b91b6 
>   ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/service_check.py
b10b602 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
d00ae40 
>   ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_server.py
e402eaa 
> 
> Diff: https://reviews.apache.org/r/31212/diff/
> 
> 
> Testing
> -------
> 
> Deployed a 3-node cluster with HDFS, Yarn, MR, TEZ, ZK, Ranger, Kafka, and Spark, then
added Namenode HA, Kerberized the cluster, and performed an RU.
> 
> ----------------------------------------------------------------------
> Total run:598
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message