Return-Path: X-Original-To: apmail-ambari-dev-archive@www.apache.org Delivered-To: apmail-ambari-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 60B58177FF for ; Tue, 14 Apr 2015 04:08:42 +0000 (UTC) Received: (qmail 9084 invoked by uid 500); 14 Apr 2015 04:08:42 -0000 Delivered-To: apmail-ambari-dev-archive@ambari.apache.org Received: (qmail 9049 invoked by uid 500); 14 Apr 2015 04:08:42 -0000 Mailing-List: contact dev-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list dev@ambari.apache.org Received: (qmail 9034 invoked by uid 99); 14 Apr 2015 04:08:41 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Apr 2015 04:08:41 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id 2B56A1D9B1B; Tue, 14 Apr 2015 04:08:43 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============9074164146000197640==" MIME-Version: 1.0 Subject: Re: Review Request 33130: Ambari unable to start services using non-default kinit_path_local From: "Andrew Onischuk" To: "Andrew Onischuk" , "Vitalyi Brodetskyi" , "Jonathan Hurley" Cc: "Robert Levas" , "Ambari" Date: Tue, 14 Apr 2015 04:08:43 -0000 Message-ID: <20150414040843.14115.90956@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: "Andrew Onischuk" X-ReviewGroup: Ambari X-ReviewRequest-URL: https://reviews.apache.org/r/33130/ X-Sender: "Andrew Onischuk" References: <20150413141102.14114.40159@reviews.apache.org> In-Reply-To: <20150413141102.14114.40159@reviews.apache.org> Reply-To: "Andrew Onischuk" X-ReviewRequest-Repository: ambari --===============9074164146000197640== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33130/#review79985 ----------------------------------------------------------- Ship it! Ship It! - Andrew Onischuk On April 13, 2015, 2:10 p.m., Robert Levas wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/33130/ > ----------------------------------------------------------- > > (Updated April 13, 2015, 2:10 p.m.) > > > Review request for Ambari, Andrew Onischuk, Jonathan Hurley, and Vitalyi Brodetskyi. > > > Bugs: AMBARI-10452 > https://issues.apache.org/jira/browse/AMBARI-10452 > > > Repository: ambari > > > Description > ------- > > PROBLEM: Ambari is unable to start services after running the Enable Security wizard on a cluster that uses a non-standard path to the Kerberos utilities, such as kinit. > > STEPS TO REPRODUCE: > 1. Start with non-Kerberized cluster (2.2 Sandbox works fine) > 2. Move Kerberos utilities from /usr/bin/ to a new location, example: /usr/myorg/bin/ > 3. Run 'Enable Security' wizard in Ambari, specify new path for kinit, Apply > 4. Watch 'Start All Services' step fail > 5. Attempt to 'Restart all components with Stale Configs for HDFS,' which fails with the following error: > > Fail: Execution of ' -kt /etc/security/keytabs/hdfs.headless.keytab hdfs' returned 127. -bash: -kt: command not found > > Due to the error that occurs with trying to manually restart the HDFS service, it seems like kinit_path_local is empty when the path to kinit is modified. It looks like each service uses the function from: > ./ambari-common/src/main/python/resource_management/libraries/functions/get_kinit_path.py > > But typically only these three hardcoded paths are passed to that function: > /usr/bin, /usr/kerberos/bin, /usr/sbin > > The custom path defined in Ambari is never passed to that function, so the result is always empty. > > > Diffs > ----- > > ambari-agent/src/main/python/ambari_agent/alerts/web_alert.py ab68560 > ambari-common/src/main/python/resource_management/libraries/functions/find_executable.py ad5eb0c > ambari-common/src/main/python/resource_management/libraries/functions/find_path.py 45f2269 > ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py 2d7cd61 > ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py f9fb396 > ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/status_params.py 5ce3d4f > ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py e986fdd > ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py bc3d21e > ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py 98f0473 > ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 14a06d3 > ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py 63639c4 > ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py 7611ec1 > ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 66332bb > ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py 3d1e18e > ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 96d68b3 > ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_webhcat_server.py fb6c4c2 > ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params.py e4e52b8 > ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/status_params.py 3b75b98 > ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/kerberos_common.py e3032bd > ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/service_check.py 738d511 > ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/status_params.py 1c73f40 > ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 6fc4fb0 > ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py f420ba6 > ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py 874de56 > ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/alerts/alert_check_oozie_server.py 9e65e6b > ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py c9ae569 > ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py 5ae57fe > ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py 2be49fa > ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py c05de5a > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285 > ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py d5278c4 > ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py 2c06d16 > ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py 3245ff0 > ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params.py 871162a > ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 5ed99fd > ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py ef92b76 > ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 5b2c953 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HBASE/package/scripts/params.py 88e02e7 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HDFS/package/scripts/params.py 7360835 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/files/alert_hive_thrift_port.py 96d68b3 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/scripts/params.py 9dd7f89 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/files/alert_check_oozie_server.py 9e2775b > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/scripts/params.py a7236ce > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/PIG/package/scripts/params.py b2c5441 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/WEBHCAT/package/files/alert_webhcat_server.py fb6c4c2 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/YARN/package/scripts/params.py 5a31518 > ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/ZOOKEEPER/package/scripts/params.py a0d504b > ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/YARN/package/scripts/params.py 55fda42 > ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/FALCON/package/scripts/params.py 78d22b4 > ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/YARN/package/scripts/params.py 55fda42 > ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/KNOX/package/scripts/params.py b5c61e8 > ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/SLIDER/package/scripts/params.py 9b6731e > ambari-server/src/main/resources/stacks/HDPWIN/2.1/services/YARN/package/scripts/params.py e48655d > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HBASE/package/scripts/params.py f745e39 > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HDFS/package/scripts/params.py 91aca2f > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HIVE/package/scripts/params.py fed3287 > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/NAGIOS/package/scripts/params.py 8bec940 > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/OOZIE/package/scripts/params.py b46ab73 > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/PIG/package/scripts/params.py 6284aed > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/YARN/package/scripts/params.py 23bbc39 > ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/ZOOKEEPER/package/scripts/params.py fdf7ddc > ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_common_services/HIVE/0.11.0.2.0.5.0/package/scripts/params.py a49e231 > ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_stack/HIVE/package/scripts/params.py a49e231 > ambari-server/src/test/resources/stacks/HDP/2.0.7/services/HIVE/package/scripts/params.py 7817a4d > > Diff: https://reviews.apache.org/r/33130/diff/ > > > Testing > ------- > > Manually tested to see custom Kerberos executables (kadmin, kinit, klist, etc...) were found in custom path > > #Jenkins test results: PENDING > > > Thanks, > > Robert Levas > > --===============9074164146000197640==--