Return-Path: X-Original-To: apmail-ambari-user-archive@www.apache.org Delivered-To: apmail-ambari-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E70B6113C3 for ; Mon, 30 Jun 2014 16:06:56 +0000 (UTC) Received: (qmail 34593 invoked by uid 500); 30 Jun 2014 16:06:56 -0000 Delivered-To: apmail-ambari-user-archive@ambari.apache.org Received: (qmail 34556 invoked by uid 500); 30 Jun 2014 16:06:56 -0000 Mailing-List: contact user-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ambari.apache.org Delivered-To: mailing list user@ambari.apache.org Received: (qmail 34546 invoked by uid 99); 30 Jun 2014 16:06:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 30 Jun 2014 16:06:56 +0000 X-ASF-Spam-Status: No, hits=3.1 required=5.0 tests=AC_DIV_BONANZA,HTML_MESSAGE,HTTP_ESCAPED_HOST,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of swagle@hortonworks.com designates 209.85.128.176 as permitted sender) Received: from [209.85.128.176] (HELO mail-ve0-f176.google.com) (209.85.128.176) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 30 Jun 2014 16:06:52 +0000 Received: by mail-ve0-f176.google.com with SMTP id db12so8223305veb.7 for ; Mon, 30 Jun 2014 09:06:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=5FEEbIlXntp8UOUsMIj8IrDihjunPdKMhqHO9ILHsD0=; b=j56qu0D9eYIj77XX6piUze3ae2OE1tUmKV5dRMn7oeeAtFiQb5qgvjh+oOgy7J8Mws YtJf6oeK9klFcSThs5EaJxz18YkKfzSKdB60FYkedYA5MNgGSBi8guImemP0kTBsEBpJ bdsuy2mhQqHaydlblVvqi5WVS8SO8wgiqKOvm3W5UtHxyn2DkPbZwRt55H0wXzRBjnr1 B4jnPlDnqlU2yZxLbCUg5PBLbuvL3wjRcvgN/JXYAlb5Q5Eetv/KhLrTpMewbnSrXX+D tx1voEOHL+0lqXdNXCCZDsE6HhGnBdzeMo8LpuS2zBDKvlYdOagUIsB3XEuLAc673gm4 fWvw== X-Gm-Message-State: ALoCoQmaqYlzdGwl1bu8rFxjSLdcSkyZ7d36PrHXfIQSOEKiBZWUYV+96bdTwjjk2LL+3Z+XBtRk0J4UgB87oA4kNfLrstsabL6Ti5qG4/J8EMBLZ+Pu5Rw= MIME-Version: 1.0 X-Received: by 10.220.202.69 with SMTP id fd5mr1511832vcb.43.1404144391571; Mon, 30 Jun 2014 09:06:31 -0700 (PDT) Received: by 10.58.210.4 with HTTP; Mon, 30 Jun 2014 09:06:31 -0700 (PDT) In-Reply-To: <09424361EA1CD144AF82069AFF5392C10147F867@MOKSCY3MSGUSRGB.ITServices.sbc.com> References: <09424361EA1CD144AF82069AFF5392C10147F81D@MOKSCY3MSGUSRGB.ITServices.sbc.com> <09424361EA1CD144AF82069AFF5392C10147F84B@MOKSCY3MSGUSRGB.ITServices.sbc.com> <53B17BD5.5030201@hortonworks.com> <09424361EA1CD144AF82069AFF5392C10147F867@MOKSCY3MSGUSRGB.ITServices.sbc.com> Date: Mon, 30 Jun 2014 09:06:31 -0700 Message-ID: Subject: Re: ambari upgrade From: Siddharth Wagle To: "user@ambari.apache.org" Content-Type: multipart/alternative; boundary=001a11c1be70ac625804fd0fd73a X-Virus-Checked: Checked by ClamAV on apache.org --001a11c1be70ac625804fd0fd73a Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Emine, This would happen if, you had custom service components defined in the stack definition before the upgrade. Ambari upgrade would override the stack definition with newer versions of the stack, example HDP-1.3.3 and the service component that was added previously to the XML definition would no longer be availble to Ambari server. If you look at the /var/log/ambari-server/ambari-sever.log, you should be able to see a ServiceComponentNotFoundException with the name to the service component that is missing. Solution: 1. Add the definition of the service component to the stack and restart the server. 2. This is a little bit more involved: - Check the relationships for the service component from the servicecomponentdesiredstate outwards. - If no relationships exists delete the row from servicecomponentdesiredstate. - If there is a host component for the foreign service component, it better to go with solution 1, since it will involve only XML edits and no changing of DB state. - A service component can be deleted only when all its child host components are deleted. Best Regards, Sid On Mon, Jun 30, 2014 at 8:05 AM, ILOGLU, EMINE wrote: > This is a mystery to me. At each attempt a different service/services > disappear from the UI and sometimes they are all fine.. Any idea what cou= ld > be the root cause? The postgress db shows all the services as > INSTALLED/STARTED state. > > > > *Emine Iloglu* > > AT&T - Common Services Systems Architecture (CSSA) > > T: 848-218-2108 | Q: ei947t > > (Remote, Eastern Timezone) > > > > > > *From:* Nate Cole [mailto:ncole@hortonworks.com] > *Sent:* Monday, June 30, 2014 11:02 AM > > *To:* user@ambari.apache.org > *Subject:* Re: ambari upgrade > > > > The public-repo is only trying to determine information about stacks, but > does not affect existing clusters. > > On 6/30/14 10:51 AM, ILOGLU, EMINE wrote: > > From 1.4.4 to 1.6.0 > > HDP is 1.3.3 , using an internal repo > > > > After the upgrade, I see this in the log file: > > 07:38:22,307 INFO [main] StackExtensionHelper:358 - No services defined > for stack: HDP-1.3.3 > > 07:38:23,229 INFO [Stack Version Loading Thread] LatestRepoCallable:73 - > Loading latest URL info from > http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json > > 07:38:25,233 ERROR [Stack Version Loading Thread] LatestRepoCallable:90 - > Could not load the URI > http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (connect timed > out) > > 07:38:25,233 INFO [Stack Version Loading Thread] LatestRepoCallable:73 - > Loading latest URL info from > http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json > > 07:38:27,236 ERROR [Stack Version Loading Thread] LatestRepoCallable:90 - > Could not load the URI > http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (connect timed > out) > > 07:38:27,237 INFO [Stack Version Loading Thread] LatestRepoCallable:73 - > Loading latest URL info from > http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json > > 07:38:29,244 ERROR [Stack Version Loading Thread] LatestRepoCallable:90 - > Could not load the URI > http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (Read timed out= ) > > 07:38:29,248 WARN [main] ActionDefinitionManager:117 - Ignoring action > definition as a different definition by that name already exists. > ActionDefinition: actionName: ambari_hdfs_rebalancer actionType: SYSTEM > inputs: threshold,[principal],[keytab] description: HDFS Rebalance > targetService: HDFS targetComponent: NAMENODE defaultTimeout: 600 > targetType: ANY > > 07:38:29,248 WARN [main] ActionDefinitionManager:117 - Ignoring action > definition as a different definition by that name already exists. > ActionDefinition: actionName: nagios_update_ignore actionType: SYSTEM > inputs: [nagios_ignore] description: Used to create an alert blackout > targetService: NAGIOS targetComponent: NAGIOS_SERVER defaultTimeout: 60 > targetType: ANY > > > > And at this attempt to upgrade, I see HDFS and Nagios are missing and all > the other services do exist. > > Why is it trying to go public-repo? That might be the problem right? > > > > Thanks > > *Emine Iloglu* > > AT&T - Common Services Systems Architecture (CSSA) > > T: 848-218-2108 | Q: ei947t > > (Remote, Eastern Timezone) > > > > > > *From:* Sumit Mohanty [mailto:smohanty@hortonworks.com > ] > *Sent:* Monday, June 30, 2014 10:46 AM > *To:* user@ambari.apache.org > *Subject:* Re: ambari upgrade > > > > What version did you upgrade from? What is the version of stack? > > > > What does these calls return (assumes default login/password - change it > as needed? > > > > curl-u admin:admin http:// host>:8080/api/v1/clusters/ > > curl-u admin:admin http:// host>:8080/api/v1/clusters//services > > > > On Mon, Jun 30, 2014 at 6:45 AM, ILOGLU, EMINE wrote: > > Hi all, > > > > After I upgrade ambari to 1.6.0, I don=E2=80=99t see any servers on the a= mbari UI, > however they are all in postgress in hostcomponentdesiredstate and > servicecomponentdesiredstate tables. > > > > Any ideas? > > > > *Emine Iloglu* > > AT&T - Common Services Systems Architecture (CSSA) > > T: 848-218-2108 | Q: ei947t > > (Remote, Eastern Timezone) > > > > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential= , > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified th= at > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediate= ly > and delete it from your system. Thank You. > > > > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential= , > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified th= at > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediate= ly > and delete it from your system. Thank You. > --=20 CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to= =20 which it is addressed and may contain information that is confidential,=20 privileged and exempt from disclosure under applicable law. If the reader= =20 of this message is not the intended recipient, you are hereby notified that= =20 any printing, copying, dissemination, distribution, disclosure or=20 forwarding of this communication is strictly prohibited. If you have=20 received this communication in error, please contact the sender immediately= =20 and delete it from your system. Thank You. --001a11c1be70ac625804fd0fd73a Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi = Emine,

This would happen if, you had custom service components= defined in the stack definition before the upgrade.

Ambari up= grade would override the stack definition with newer versions of the stack,= example HDP-1.3.3 and the service component that was added previously to t= he XML definition would no longer be availble to Ambari server.

If you look at the /var/log/ambari-server/ambari-sever.log, = you should be able to see a ServiceComponentNotFoundException with the name= to the service component that is missing.

Solution= :
1. Add the definition of the service component to the stack and resta= rt the server.
2. This is a little bit more involved:
=C2= =A0 - Check the relationships for the service component from the servicecomponentdesiredstate outwards.
=C2=A0 - If no relationships exists delete the row from servicecomponentdesiredstate.
=C2=A0 - If there is a = host component for the foreign service component, it better to go with solu= tion 1, since it will involve only XML edits and no changing of DB state.
=C2=A0 - A service component can be deleted only when all its child h= ost components are deleted.

Best Regards,
Sid


On Mon, Jun= 30, 2014 at 8:05 AM, ILOGLU, EMINE <ei947t@att.com> wrote:

This is a mystery to me. At each attempt a= different service/services disappear from the UI and sometimes they are al= l fine.. Any idea what could be the root cause? The postgress db shows all the services as INSTALLED/STARTED state.=

=C2=A0

Emine = Iloglu

AT&T - Common Services Systems Archi= tecture (CSSA)

T: 848-218-2108 | Q: ei947t

(Remote, E= astern Timezone)

=C2=A0

=C2=A0

From: Nate Cole [mailto:ncole@hortonworks.com]
Sent: Monday, June 30, 2014 11:02 AM


To: user= @ambari.apache.org
Subject: Re: ambari upgrade

=C2=A0

The public-repo is on= ly trying to determine information about stacks, but does not affect existi= ng clusters.

On 6/30/14 10:51 AM, ILOGLU, EMINE wrote:<= /u>

From 1.4.4 to 1.6.0

HDP is 1.3.3 , using an internal repo

=C2=A0

After the upgrade, I see this in the log f= ile:

07:38:22,307=C2=A0 INFO [main] StackExtens= ionHelper:358 - No services defined for stack: HDP-1.3.3

07:38:23,229=C2=A0 INFO [Stack Version Loa= ding Thread] LatestRepoCallable:73 - Loading latest URL info from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json<= /span>

07:38:25,233 ERROR [Stack Version Loading = Thread] LatestRepoCallable:90 - Could not load the URI http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json = (connect timed out)

07:38:25,233=C2=A0 INFO [Stack Version Loa= ding Thread] LatestRepoCallable:73 - Loading latest URL info from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json<= /span>

07:38:27,236 ERROR [Stack Version Loading = Thread] LatestRepoCallable:90 - Could not load the URI http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json = (connect timed out)

07:38:27,237=C2=A0 INFO [Stack Version Loa= ding Thread] LatestRepoCallable:73 - Loading latest URL info from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json<= /span>

07:38:29,244 ERROR [Stack Version Loading = Thread] LatestRepoCallable:90 - Could not load the URI http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json = (Read timed out)

07:38:29,248=C2=A0 WARN [main] ActionDefin= itionManager:117 - Ignoring action definition as a different definition by = that name already exists. ActionDefinition: actionName: ambari_hdfs_rebalan= cer actionType: SYSTEM inputs: threshold,[principal],[keytab] description: HDF= S Rebalance targetService: HDFS targetComponent: NAMENODE defaultTimeout: 6= 00 targetType: ANY

07:38:29,248=C2=A0 WARN [main] ActionDefin= itionManager:117 - Ignoring action definition as a different definition by = that name already exists. ActionDefinition: actionName: nagios_update_ignor= e actionType: SYSTEM inputs: [nagios_ignore] description: Used to create an = alert blackout targetService: NAGIOS targetComponent: NAGIOS_SERVER default= Timeout: 60 targetType: ANY

=C2=A0

And at this attempt to upgrade, I see HDFS= and Nagios are missing and all the other services do exist.<= u>

Why is it trying to go public-repo? That m= ight be the problem right?

=C2=A0

Thanks

Emine = Iloglu

AT&T - Common Services Systems Archi= tecture (CSSA)

T: 848-218-2108 | Q: ei947t

(Remote, E= astern Timezone)

=C2=A0

=C2=A0

From: Sumit Mo= hanty [mailto= :smohanty@hortonworks.com]
Sent: Monday, June 30, 2014 10:46 AM
To: user= @ambari.apache.org
Subject: Re: ambari upgrade

=C2=A0

What version did you upgrade from? What is the versi= on of stack?

=C2=A0

What does these calls return (assumes default login/= password - change it as needed?

=C2=A0

curl-u admin:admin http://<ambari server host>:8080/api/v1/clusters/&l= t;clustername>

curl-u admin:admin http://<ambari server host>:8080/api/v1/clusters/&l= t;clustername>/services

=C2=A0<= /p>

On Mon, Jun 30, 2014 at 6:45 AM, ILOGLU, EMINE <<= a href=3D"mailto:ei947t@att.com" target=3D"_blank">ei947t@att.com> w= rote:

Hi all,

=C2=A0

After I upgrade ambari to 1.6.0, I don=E2= =80=99t see any servers on the ambari UI, however they are all in postgress= in hostcomponentdesiredstate and servicecomponentdesiredstate tables.

=C2=A0

Any ideas?

=C2=A0

Emine Iloglu

AT&T - Common Services Systems Archi= tecture (CSSA)

T: 848-218-2108 | Q: ei947t=

(Remote, Eastern Timezone)

=C2=A0


CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to= which it is addressed and may contain information that is confidential, pr= ivileged and exempt from disclosure under applicable law. If the reader of = this message is not the intended recipient, you are hereby notified that any printing, copying, disseminati= on, distribution, disclosure or forwarding of this communication is strictl= y prohibited. If you have received this communication in error, please cont= act the sender immediately and delete it from your system. Thank You.

=C2=A0


CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to= which it is addressed and may contain information that is confidential, pr= ivileged and exempt from disclosure under applicable law. If the reader of = this message is not the intended recipient, you are hereby notified that any printing, copying, disseminati= on, distribution, disclosure or forwarding of this communication is strictl= y prohibited. If you have received this communication in error, please cont= act the sender immediately and delete it from your system. Thank You.=



CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u. --001a11c1be70ac625804fd0fd73a--