ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitro Lisnichenko" <dlysniche...@hortonworks.com>
Subject Re: Review Request 21172: Fail to install hive client with error: Fail: Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5 http://hadoop1:8080/resources/DBConnectionVerification.jar -o DBConnectionVerification.jar'' returned 22.
Date Thu, 08 May 2014 10:53:12 GMT


> On May 8, 2014, 12:03 a.m., Mahadev Konar wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java, line
242
> > <https://reviews.apache.org/r/21172/diff/1/?file=576277#file576277line242>
> >
> >     Why did we change this?

Because at clusterHostInfo we don't send hostnames as strings. We send a complete list of
hostnames only at all_hosts field. At other fields we send only integer indexes of hostname
at all_hosts list. This optimisation (collapsing hostnames) has been done to reduce heartbeat
size on large clusters.


> On May 8, 2014, 12:03 a.m., Mahadev Konar wrote:
> > ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py,
line 37
> > <https://reviews.apache.org/r/21172/diff/1/?file=576280#file576280line37>
> >
> >     So we are using the same hostname that ambari server is configured with?

Yes. At server, this hostname is a result of InetAddress.getLocalHost().getCanonicalHostName()
call


- Dmitro


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21172/#review42441
-----------------------------------------------------------


On May 7, 2014, 8:28 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21172/
> -----------------------------------------------------------
> 
> (Updated May 7, 2014, 8:28 p.m.)
> 
> 
> Review request for Ambari, Dmytro Sen and Mahadev Konar.
> 
> 
> Bugs: AMBARI-5705
>     https://issues.apache.org/jira/browse/AMBARI-5705
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> PROBLEM: Fresh install of HDP 2.1, when deploying hive client it fail with error: Execution
of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5 http://hadoop1:8080/resources/DBConnectionVerification.jar
-o DBConnectionVerification.jar'' returned 22.
> Steps to reproduce: set up a proxy (http_proxy="<proxy host that has not access to
cluster>").
> Fix: 
> Added
> --noproxy <ambari-server hostname>
> option to all our curl invocations that download files from ambari-server. I would go
for this option because sometimes ftp_proxy may be used as well.
> Also, I've fixed an error message that is shown when jce_name property is not defined
in a non-secure cluster and added a proper handling of this situation in secure cluster. 
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java f8b9636

>   ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/params.py
f2a4199 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/shared_initialization.py
4a0669b 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py
897e669 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/shared_initialization.py
3fa511a 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive.py
5f2f15e 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py
bf52dba 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_namenodes_ha.sh
50b075a 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_nodemanager_health.sh
020b41d 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_templeton_status.sh
7fbc4c4 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_webui.sh
b23045e 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/oozie.py
6523fbd 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/params.py
bb6e27c 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/WEBHCAT/package/files/templetonSmoke.sh
cefc4f0 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py
1f8bfa8 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py
8affb55 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
91c06f5 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py
b91b1a0 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive.py
42a8610 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py
ab4aee7 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_namenodes_ha.sh
50b075a 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_nodemanager_health.sh
020b41d 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_templeton_status.sh
7fbc4c4 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_webui.sh
8116dc5 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py
818874d 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py
9a5df00 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/files/templetonSmoke.sh
304b459 
>   ambari-server/src/test/java/org/apache/ambari/server/utils/TestStageUtils.java ee93431

>   ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_client.py 80a3c5c 
>   ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_metastore.py 3914844 
>   ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py f5997e4 
>   ambari-server/src/test/python/stacks/1.3.2/configs/default.hbasedecom.json a1f62bd

>   ambari-server/src/test/python/stacks/1.3.2/configs/default.json 40cdc57 
>   ambari-server/src/test/python/stacks/1.3.2/configs/default.non_gmetad_host.json 00ddf6a

>   ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5 
>   ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5 
>   ambari-server/src/test/python/stacks/1.3.2/hooks/before-INSTALL/test_before_install.py
0215ba2 
>   ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_client.py 9c570d1 
>   ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_metastore.py 61ef4b5 
>   ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py c056591 
>   ambari-server/src/test/python/stacks/2.0.6/configs/default.hbasedecom.json 51e13d0

>   ambari-server/src/test/python/stacks/2.0.6/configs/default.json c621a6d 
>   ambari-server/src/test/python/stacks/2.0.6/configs/default.non_gmetad_host.json c835c94

>   ambari-server/src/test/python/stacks/2.0.6/configs/flume_target.json 4bd9aea 
>   ambari-server/src/test/python/stacks/2.0.6/configs/ha_default.json 924ed64 
>   ambari-server/src/test/python/stacks/2.0.6/configs/ha_secured.json e64b87a 
>   ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426 
>   ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426 
>   ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py
60c9704 
>   ambari-server/src/test/python/stacks/2.1/HIVE/test_hive_metastore.py 0f1ad88 
>   ambari-server/src/test/python/stacks/2.1/configs/default.json 6400314 
>   ambari-server/src/test/python/stacks/2.1/configs/secured.json 245e5dd 
> 
> Diff: https://reviews.apache.org/r/21172/diff/
> 
> 
> Testing
> -------
> 
> performed manual cluster installation using 1.3.2 and 2.1 stack.
> 
> Unit test run:
> [INFO] 63 resources included (use -debug for more details)
> [INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 approved: 34
licence.
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Ambari Main ....................................... SUCCESS [4.221s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.322s]
> [INFO] Ambari Web ........................................ SUCCESS [9.192s]
> [INFO] Ambari Views ...................................... SUCCESS [3.259s]
> [INFO] Ambari Server ..................................... SUCCESS [19:02.503s]
> [INFO] Ambari Agent ...................................... SUCCESS [9.098s]
> [INFO] Ambari Client ..................................... SUCCESS [0.762s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 19:30.050s
> [INFO] Finished at: Wed May 07 23:26:36 FET 2014
> [INFO] Final Memory: 27M/252M
> [INFO] ------------------------------------------------------------------------
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message