Return-Path: X-Original-To: apmail-ambari-dev-archive@www.apache.org Delivered-To: apmail-ambari-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 001891862F for ; Tue, 25 Aug 2015 14:48:37 +0000 (UTC) Received: (qmail 35056 invoked by uid 500); 25 Aug 2015 14:48:37 -0000 Delivered-To: apmail-ambari-dev-archive@ambari.apache.org Received: (qmail 35022 invoked by uid 500); 25 Aug 2015 14:48:37 -0000 Mailing-List: contact dev-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list dev@ambari.apache.org Received: (qmail 35006 invoked by uid 99); 25 Aug 2015 14:48:37 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Aug 2015 14:48:37 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id E8C2B26B0B6; Tue, 25 Aug 2015 14:48:36 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============2533618137241961764==" MIME-Version: 1.0 Subject: Re: Review Request 37758: Ambari startup scripts exhibit long delays (5+ seconds each) on every "modifying user" operation. This adds a few minutes to the time it takes to start or restart any component, causing excessive downtime for every config change. From: "Andrew Onischuk" To: "Dmitro Lisnichenko" , "Vitalyi Brodetskyi" Cc: "Andrew Onischuk" , "Ambari" Date: Tue, 25 Aug 2015 14:48:36 -0000 Message-ID: <20150825144836.13583.15601@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: "Andrew Onischuk" X-ReviewGroup: Ambari X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/37758/ X-Sender: "Andrew Onischuk" References: <20150825122050.13584.1908@reviews.apache.org> In-Reply-To: <20150825122050.13584.1908@reviews.apache.org> Reply-To: "Andrew Onischuk" X-ReviewRequest-Repository: ambari --===============2533618137241961764== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37758/ ----------------------------------------------------------- (Updated Aug. 25, 2015, 2:48 p.m.) Review request for Ambari, Dmitro Lisnichenko and Vitalyi Brodetskyi. Bugs: AMBARI-12871 https://issues.apache.org/jira/browse/AMBARI-12871 Repository: ambari Description ------- PROBLEM: Customer use nslcd to fetch the user from AD server, it returns a lot of users and groups, this will slow down the ambari operation (start/stop service). As discussed with Florian Barca, The root cause is a limitation in the native API: grp.getgrall() has no ability to prefilter the results, which means it fetches all users from the LDAP directory exposed by nslcd. If it happen to be a large org, with a large number of users, so the fetch takes a long time. We need to optimize this and make the code scale with the number of users. Diffs (updated) ----- ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py 4def30f ambari-server/src/test/python/stacks/2.0.6/hooks/before-ANY/test_before_any.py 37a52df Diff: https://reviews.apache.org/r/37758/diff/ Testing ------- mvn clean test Thanks, Andrew Onischuk --===============2533618137241961764==--