ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Fernandez" <afernan...@hortonworks.com>
Subject Re: Review Request 31212: Kafka & Spark service checks fail intermittently on kerberized cluster
Date Fri, 20 Feb 2015 23:52:46 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31212/
-----------------------------------------------------------

(Updated Feb. 20, 2015, 11:52 p.m.)


Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Jonathan Hurley, Nate Cole,
and Srimanth Gunturi.


Changes
-------

Addressed the comments.


Bugs: AMBARI-9717
    https://issues.apache.org/jira/browse/AMBARI-9717


Repository: ambari


Description
-------

Kafka and Spark service checks will fail intermittently.

Kafka runs a command to create a topic, which is expected to fail after being ran once, and
then greps the output to make sure that the topic was created or already existed. The problem
is that this will only work the first time, since it was not ignorring stderr. Instead, just
call the command, and perform a regex match on the output.

Spark was not kiniting before doing its service check. I presume it worked sometimes if some
credenetial had already been cached.


Diffs (updated)
-----

  ambari-common/src/main/python/resource_management/libraries/functions/validate.py PRE-CREATION

  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py
80b91b6 
  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/service_check.py
b10b602 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
d00ae40 
  ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_server.py
e402eaa 

Diff: https://reviews.apache.org/r/31212/diff/


Testing
-------

Deployed a 3-node cluster with HDFS, Yarn, MR, TEZ, ZK, Ranger, Kafka, and Spark, then added
Namenode HA, Kerberized the cluster, and performed an RU.

Unit tests are in progress.


Thanks,

Alejandro Fernandez


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message