incubator-ambari-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yusaku Sako <yus...@hortonworks.com>
Subject Re: Single Node Hadoop Deployment: Errors
Date Fri, 22 Mar 2013 23:10:18 GMT
Hi Gunnar,

In the error log that you posted originally, the Ambari Agent was trying to
download the JDK from
http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin>
(which
actually maps to /var/lib/ambari-server/resources/jdk-6u31-linux-x64.bin on
the Ambari Server), but the file was not there (404).
This can happen if you specify the -j option during "ambari-server setup".
With the -j option, setup won't download the JDK and place it in the
aforementioned directory.
If the -j option is specified but in Install Options of the Install Wizard
you don't specify the custom JDK path, then the error can happen.

When doing ambari-server setup without the -j option, it will download the
JDK and places it in that directory.

Both cases you mentioned should have worked (-j with custom JDK path
specified, and no -j without custom JDK path specified).
Can you see if /var/lib/ambari-server/resources/jdk-6u31-linux-x64.bin is
there on the Ambari server host?
If it is not there, try running ambari-server setup (without the -j
option).  It should download it for you automatically.  If not, please file
a bug.

Yusaku


On Fri, Mar 22, 2013 at 11:33 AM, Tapper, Gunnar <gunnar.tapper@hp.com>wrote:

>  Hi,****
>
> ** **
>
> I installed JDK instead and did a chmod +x /opt /opt/home/
> /opt/home/jdk1.6.0_34 on both the ambari server and ambari agent node. I
> tried ambari-server reset followed by ambari-server setup –j jdk1.6.0_34 as
> well as ambari-server reset followed by ambari-server setup (without the –j
> option.) No success.****
>
> ** **
>
> Sincerely,****
>
> ** **
>
> Gunnar****
>
> ** **
>
> *Innovation is a team sport* — Michael Idechik, vice president of
> advanced technologies, General Electric****
>
> ** **
>
> ** **
>
> *From:* Tapper, Gunnar
> *Sent:* Friday, March 22, 2013 11:06 AM
> *To:* ambari-user@incubator.apache.org
> *Subject:* RE: Single Node Hadoop Deployment: Errors****
>
> ** **
>
> I did:****
>
> ** **
>
> ambari-server setup -j /opt/home/jre1.6.0_33****
>
> Using python  /usr/bin/python2.6****
>
> Run postgresql initdb****
>
> Initializing database:                                     [  OK  ]****
>
> Run postgresql start****
>
> Starting postgresql service:                               [  OK  ]****
>
> Setup ambari-server****
>
> Checking SELinux...****
>
> SELinux status is 'disabled'****
>
> Checking iptables...****
>
> iptables is disabled now****
>
> Checking PostgreSQL...****
>
> Configuring database...****
>
> Enter advanced database configuration [y/n] (n)? n****
>
> Configuring PostgreSQL...****
>
> Restarting PostgreSQL****
>
> Checking JDK...****
>
> WARNING: JAVA_HOME /opt/home/jre1.6.0_33 must be valid on ALL hosts****
>
> Completing setup...****
>
> Ambari Server 'setup' finished successfully****
>
> ** **
>
> On server01:****
>
> ** **
>
> [root@server01 home]# /opt/home/jre1.6.0_33/bin/java -version****
>
> java version "1.6.0_33"****
>
> Java(TM) SE Runtime Environment (build 1.6.0_33-b04)****
>
> Java HotSpot(TM) Server VM (build 20.8-b03, mixed mode)****
>
> ** **
>
> On server09:****
>
> ** **
>
> [root@server09 home]# /opt/home/jre1.6.0_33/bin/java -version****
>
> java version "1.6.0_33"****
>
> Java(TM) SE Runtime Environment (build 1.6.0_33-b04)****
>
> Java HotSpot(TM) Server VM (build 20.8-b03, mixed mode)****
>
> ** **
>
> I also specify /opt/home/jre1.6.0_33 on the Install Options page when
> checking “Path to 64-bit JDK JAVA_HOME”. Now looking at it, maybe JDK is
> needed instead of JRE?****
>
> ** **
>
> Sincerely,****
>
> ** **
>
> Gunnar****
>
> ** **
>
> *Innovation is a team sport* — Michael Idechik, vice president of
> advanced technologies, General Electric****
>
> ** **
>
> ** **
>
> ** **
>
> *From:* Yusaku Sako [mailto:yusaku@hortonworks.com<yusaku@hortonworks.com>]
>
> *Sent:* Friday, March 22, 2013 10:58 AM
> *To:* ambari-user@incubator.apache.org
> *Subject:* Re: Single Node Hadoop Deployment: Errors****
>
> ** **
>
> Hi Gunnar,
>
>
> Did you happen to specify the custom JDK "-j" option during "ambari-server
> setup"?
>
> Yusaku****
>
>  On Fri, Mar 22, 2013 at 9:40 AM, Tapper, Gunnar <gunnar.tapper@hp.com>
> wrote:****
>
> Hi,****
>
>  ****
>
> I’m doing something somewhat strange: Installing a single-node cluster
> using Ambari. I have one node for the Ambari server and another node for
> the Ambari Agent. The Ambari Agent was installed “by hand” and is started.
> All works well until the provisioning begins. At that time, I run into:***
> *
>
>  ****
>
> notice: Finished catalog run in 0.06 seconds****
>
> notice: Finished catalog run in 0.06 seconds****
>
> warning: Dynamic lookup of $service_state at
> /var/lib/ambari-agent/puppet/modules/hdp-hadoop/manifests/init.pp:163 is
> deprecated.  Support will be removed in Puppet 2.8.  Use a fully-qualified
> variable name (e.g., $classname::variable) or parameterized classes.****
>
> warning: Dynamic lookup of $service_state at
> /var/lib/ambari-agent/puppet/modules/hdp-hadoop/manifests/service.pp:74 is
> deprecated.  Support will be removed in Puppet 2.8.  Use a fully-qualified
> variable name (e.g., $classname::variable) or parameterized classes.****
>
> warning: Dynamic lookup of $service_state at
> /var/lib/ambari-agent/puppet/modules/hdp-hadoop/manifests/service.pp:83 is
> deprecated.  Support will be removed in Puppet 2.8.  Use a fully-qualified
> variable name (e.g., $classname::variable) or parameterized classes.****
>
> warning: Dynamic lookup of $ambari_db_server_host is deprecated.  Support
> will be removed in Puppet 2.8.  Use a fully-qualified variable name (e.g.,
> $classname::variable) or parameterized classes.****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Exec[mkdir
> -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp]/returns:   % Total    %
> Received % Xferd  Average Speed   Time    Time     Time  Current****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Exec[mkdir
> -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin
> snmp]/returns:                                  Dload  Upload   Total
> Spent    Left  Speed****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Exec[mkdir
> -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp]/returns:
> ****
>
>   0     0    0     0    0     0      0      0 --:--:-- --:--:--
> --:--:--     0****
>
>   0     0    0     0    0     0      0      0 --:--:-- --:--:--
> --:--:--     0****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Exec[mkdir
> -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://bronto01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://bronto01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp]/returns: curl: (22) The
> requested URL returned error: 404****
>
> err:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Exec[mkdir
> -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp]/returns: change from
> notrun to 0 failed: mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin returned 22 instead of one of
> [0] at /var/lib/ambari-agent/puppet/modules/hdp/manifests/java/package.pp:48
> ****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Exec[mkdir
> -p /usr/jdk64 ; chmod +x /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin; cd
> /usr/jdk64 ; echo A | /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin
> -noregister > /dev/null 2>&1 snmp]: Dependency Exec[mkdir -p
> /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Exec[mkdir
> -p /usr/jdk64 ; chmod +x /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin; cd
> /usr/jdk64 ; echo A | /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin
> -noregister > /dev/null 2>&1 snmp]: Skipping because of failed dependencies
> ****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/File[/usr/jdk64/jdk1.6.0_31/bin/java
> snmp]: Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/File[/usr/jdk64/jdk1.6.0_31/bin/java
> snmp]: Skipping because of failed dependencies****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Anchor[hdp::java::package::snmp::end]:
> Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/Anchor[hdp::java::package::snmp::end]:
> Skipping because of failed dependencies****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Anchor[hdp::package::snmp::end]:
> Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Anchor[hdp::package::snmp::end]:
> Skipping because of failed dependencies****
>
> notice:
> /Stage[1]/Hdp::Snmp/Hdp::Snmp-configfile[snmpd.conf]/Hdp::Configfile[/etc/snmp//snmpd.conf]/File[/etc/snmp//snmpd.conf]:
> Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[1]/Hdp::Snmp/Hdp::Snmp-configfile[snmpd.conf]/Hdp::Configfile[/etc/snmp//snmpd.conf]/File[/etc/snmp//snmpd.conf]:
> Skipping because of failed dependencies****
>
> notice: /Stage[1]/Hdp::Snmp/Service[snmpd]: Dependency Exec[mkdir -p
> /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning: /Stage[1]/Hdp::Snmp/Service[snmpd]: Skipping because of failed
> dependencies****
>
> notice: /Stage[1]/Hdp::Snmp/Anchor[hdp::snmp::end]: Dependency Exec[mkdir
> -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning: /Stage[1]/Hdp::Snmp/Anchor[hdp::snmp::end]: Skipping because of
> failed dependencies****
>
> notice:
> /Stage[1]/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln[32]/Hdp::Exec[hdp::snappy::package::ln
> 32]/Exec[hdp::snappy::package::ln 32]/returns: executed successfully****
>
> notice:
> /Stage[2]/Hdp-hadoop::Initialize/Anchor[hdp-hadoop::initialize::begin]:
> Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[2]/Hdp-hadoop::Initialize/Anchor[hdp-hadoop::initialize::begin]:
> Skipping because of failed dependencies****
>
> notice:
> /Stage[2]/Hdp-hadoop::Initialize/Hdp-hadoop::Common[common]/Anchor[hdp-hadoop::common::begin]:
> Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[2]/Hdp-hadoop::Initialize/Hdp-hadoop::Common[common]/Anchor[hdp-hadoop::common::begin]:
> Skipping because of failed dependencies****
>
> notice: /Stage[main]/Hdp-hadoop/Anchor[hdp-hadoop::begin]: Dependency
> Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning: /Stage[main]/Hdp-hadoop/Anchor[hdp-hadoop::begin]: Skipping
> because of failed dependencies****
>
> notice:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Anchor[hdp-hadoop::package::helper::begin]:
> Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Anchor[hdp-hadoop::package::helper::begin]:
> Skipping because of failed dependencies****
>
> notice:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Hdp::Package[hadoop
> 64]/Hdp::Package::Process_pkg[hadoop 64]/Anchor[hdp::package::hadoop
> 64::begin]: Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry
> 10 http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Hdp::Package[hadoop
> 64]/Hdp::Package::Process_pkg[hadoop 64]/Anchor[hdp::package::hadoop
> 64::begin]: Skipping because of failed dependencies****
>
> notice:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Hdp::Package[hadoop
> 64]/Hdp::Package::Process_pkg[hadoop 64]/Package[hadoop-sbin]: Dependency
> Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Hdp::Package[hadoop
> 64]/Hdp::Package::Process_pkg[hadoop 64]/Package[hadoop-sbin]: Skipping
> because of failed dependencies****
>
> notice:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Hdp::Package[hadoop
> 64]/Hdp::Package::Process_pkg[hadoop 64]/Package[hadoop-libhdfs]:
> Dependency Exec[mkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
> warning:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Hdp::Package[hadoop
> 64]/Hdp::Package::Process_pkg[hadoop 64]/Package[hadoop-libhdfs]: Skipping
> because of failed dependencies****
>
> notice:
> /Stage[main]/Hdp-hadoop/Hdp-hadoop::Package[hadoop]/Hdp::Package[hadoop
> 64]/Hdp::Package::Process_pkg[hadoop 64]/Hdp::Java::Package[hadoop
> 64]/Anchor[hdp::java::package::hadoop 64::begin]: Dependency Exec[mkdir -p
> /tmp/HDP-artifacts/ ; curl -f --retry 10
> http://server01.test.hp.com:8080/resources//jdk-6u31-linux-x64.bin<http://server01.test.hp.com:8080/resources/jdk-6u31-linux-x64.bin>-o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp] has failures: true
> ****
>
>  ****
>
> Looking at the target server, the /tmp/HDP-artifacts directory is empty.**
> **
>
>  ****
>
> Any ideas what’s going on here?****
>
>  ****
>
> Sincerely,****
>
>  ****
>
> Gunnar****
>
>  ****
>
> *Innovation is a team sport* — Michael Idechik, vice president of
> advanced technologies, General Electric****
>
>  ****
>
>  ****
>
>  ****
>
>  ****
>
>  ****
>
> ** **
>

Mime
View raw message