Return-Path: X-Original-To: apmail-ambari-dev-archive@www.apache.org Delivered-To: apmail-ambari-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5394A10D18 for ; Fri, 24 Oct 2014 09:04:34 +0000 (UTC) Received: (qmail 51409 invoked by uid 500); 24 Oct 2014 09:04:34 -0000 Delivered-To: apmail-ambari-dev-archive@ambari.apache.org Received: (qmail 51371 invoked by uid 500); 24 Oct 2014 09:04:34 -0000 Mailing-List: contact dev-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list dev@ambari.apache.org Received: (qmail 51353 invoked by uid 99); 24 Oct 2014 09:04:33 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Oct 2014 09:04:33 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id AFB6E1D9BE3; Fri, 24 Oct 2014 09:04:38 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============1199395398245326073==" MIME-Version: 1.0 Subject: Re: Review Request 27081: Namenode can not leave safe mode on hdp-2.2 stack From: "Dmitro Lisnichenko" To: "Andrew Onischuk" , "Vitalyi Brodetskyi" Cc: "Dmitro Lisnichenko" , "Ambari" Date: Fri, 24 Oct 2014 09:04:38 -0000 Message-ID: <20141024090438.1283.23840@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org Auto-Submitted: auto-generated Sender: "Dmitro Lisnichenko" X-ReviewGroup: Ambari X-ReviewRequest-URL: https://reviews.apache.org/r/27081/ X-Sender: "Dmitro Lisnichenko" References: <20141023171112.1283.77024@reviews.apache.org> In-Reply-To: <20141023171112.1283.77024@reviews.apache.org> Reply-To: "Dmitro Lisnichenko" X-ReviewRequest-Repository: ambari --===============1199395398245326073== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27081/ ----------------------------------------------------------- (Updated Oct. 24, 2014, 9:04 a.m.) Review request for Ambari, Andrew Onischuk and Vitalyi Brodetskyi. Bugs: AMBARI-7925 https://issues.apache.org/jira/browse/AMBARI-7925 Repository: ambari Description ------- Initial analysis: First namenode start attempt failed for me. Probably, that caused NN to enter safe mode. After fixing perm gen memory size value, I've tried to start NN again. Our stack scripts seem to move NN out of safe mode on start if needed. But on HDP-2.2 stack, command for doing this is deprecated and fails with a non-zero exit code. 2014-10-21 16:33:25,973 - Error while executing command 'start': Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/HDFS/package/scripts/namenode.py", line 46, in start namenode(action="start") File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/HDFS/package/scripts/hdfs_namenode.py", line 60, in namenode only_if=dfs_check_nn_status_cmd #skip when HA not active File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in _init_ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run raise ex Fail: Execution of 'su -s /bin/bash - hdfs -c 'export PATH=$PATH:/usr/hdp/current/hadoop-client/bin ; hadoop --config /etc/hadoop/conf dfsadmin -safemode get' | grep 'Safe mode is OFF'' returned 1. DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. safemode: Call From 09f.vm/10.77.64.159 to 09f.vm:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused Diffs ----- ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/files/checkForFormat.sh eb48858 ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HDFS/package/files/checkForFormat.sh eb48858 ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/files/checkForFormat.sh 82dbda1 ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/files/checkForFormat.sh be8c75f ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/scripts/hdfs_namenode.py 31fc2f1 ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/scripts/namenode.py a0b07aa ambari-server/src/test/python/stacks/2.0.6/HDFS/test_namenode.py 2033a53 Diff: https://reviews.apache.org/r/27081/diff/ Testing ------- ---------------------------------------------------------------------- Ran 236 tests in 4.344s OK ---------------------------------------------------------------------- Total run:669 Total errors:0 Total failures:0 OK Thanks, Dmitro Lisnichenko --===============1199395398245326073==--