ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nate Cole" <nc...@hortonworks.com>
Subject Re: Review Request 31212: Kafka & Spark service checks fail intermittently on kerberized cluster
Date Fri, 20 Feb 2015 03:45:57 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31212/#review73250
-----------------------------------------------------------

Ship it!


Ship It!

- Nate Cole


On Feb. 19, 2015, 8:30 p.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31212/
> -----------------------------------------------------------
> 
> (Updated Feb. 19, 2015, 8:30 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Jonathan Hurley, Nate
Cole, and Srimanth Gunturi.
> 
> 
> Bugs: AMBARI-9717
>     https://issues.apache.org/jira/browse/AMBARI-9717
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Kafka and Spark service checks will fail intermittently.
> 
> Kafka runs a command to create a topic, which is expected to fail after being ran once,
and then greps the output to make sure that the topic was created or already existed. The
problem is that this will only work the first time, since it was not ignorring stderr. Instead,
just call the command, and perform a regex match on the output.
> 
> Spark was not kiniting before doing its service check. I presume it worked sometimes
if some credenetial had already been cached.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py
80b91b6 
>   ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/service_check.py
b10b602 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
d00ae40 
> 
> Diff: https://reviews.apache.org/r/31212/diff/
> 
> 
> Testing
> -------
> 
> Deployed a 3-node cluster with HDFS, Yarn, MR, TEZ, ZK, Ranger, Kafka, and Spark, then
added Namenode HA, Kerberized the cluster, and performed an RU.
> 
> Unit tests are in progress.
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message