Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: cloudstack-dev@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of abhinav.roy@citrix.com
 designates 203.166.19.134 as permitted sender)
From: Abhinav Roy <abhinav.roy@citrix.com>
To: Rohit Yadav <rohit.yadav@citrix.com>
CC: "cloudstack-dev@incubator.apache.org"
	<cloudstack-dev@incubator.apache.org>, Sowmya Krishnan
	<sowmya.krishnan@citrix.com>, Sailaja Mada <sailaja.mada@citrix.com>, Shweta
 Agarwal <Shweta.Agarwal@citrix.com>, Prashant Kumar Mishra
	<prashantkumar.mishra@citrix.com>, Suresh Sadhu <Suresh.Sadhu@citrix.com>
Date: Wed, 26 Sep 2012 02:26:53 +0530
Subject: RE: Is Restart of the KVM host (rhel 6.3) required , before adding
 it to Management server in ASF 4.0 ?
Thread-Topic: Is Restart of the KVM host (rhel 6.3) required , before adding
 it to Management server in ASF 4.0 ?
Thread-Index: Ac2bM2fPX8WLisU2RZSHi6UJWMHCSwALJ43A
Message-ID: 
 <4FCA39B99132DA4EA70BE3CE408C193D01103A2114CE@BANPMAILBOX01.citrite.net>
References: 
 <4FCA39B99132DA4EA70BE3CE408C193D01103A211391@BANPMAILBOX01.citrite.net>
 <765B3952-AEF4-4902-A84C-84F2D7332803@citrix.com>
 <4FCA39B99132DA4EA70BE3CE408C193D01103A2114A0@BANPMAILBOX01.citrite.net>
 <3F9A81C0-3A90-4380-A93A-211795F103B8@citrix.com>
In-Reply-To: <3F9A81C0-3A90-4380-A93A-211795F103B8@citrix.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: multipart/alternative;
	boundary="_000_4FCA39B99132DA4EA70BE3CE408C193D01103A2114CEBANPMAILBOX_"
MIME-Version: 1.0

--_000_4FCA39B99132DA4EA70BE3CE408C193D01103A2114CEBANPMAILBOX_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Yes Rohit. Both times we had a fresh installation of both kvm host OS and m=
anagement server.


Thanks and regards,
Abhinav

From: Rohit Yadav
Sent: Tuesday, September 25, 2012 9:06 PM
To: Abhinav Roy
Cc: cloudstack-dev@incubator.apache.org; Sowmya Krishnan; Sailaja Mada; Shw=
eta Agarwal; Prashant Kumar Mishra; Suresh Sadhu
Subject: Re: Is Restart of the KVM host (rhel 6.3) required , before adding=
 it to Management server in ASF 4.0 ?


On 25-Sep-2012, at 8:56 PM, Abhinav Roy <abhinav.roy@citrix.com<mailto:abhi=
nav.roy@citrix.com>> wrote:


Hi Rohit,

I was able to deploy advanced zone setup with http://jenkins.cloudstack.org=
/job/build-4.0-rhel63/163/artifact/CloudStack-oss-4.0.0-163.tar.bz2 build.

But again I saw the below error which I had mentioned. There was a need to =
restart the HOST before successfully adding it to the management server. At=
taching the logs too.

You may need to do that, if you'd previously had any of the old builds inst=
alled. But, do you need to do that even if you're starting with a fresh rhe=
l server for management server and the host is a freshly installed KVM host=
?

Regards.


Thanks and regards,
Abhinav

From: Rohit Yadav
Sent: Tuesday, September 25, 2012 3:31 PM
To: Abhinav Roy
Cc: cloudstack-dev@incubator.apache.org<mailto:cloudstack-dev@incubator.apa=
che.org>; Sowmya Krishnan; Sailaja Mada; Shweta Agarwal; Prashant Kumar Mis=
hra; Suresh Sadhu
Subject: Re: Is Restart of the KVM host (rhel 6.3) required , before adding=
 it to Management server in ASF 4.0 ?

Checklist:
- Latest build #160 or above from http://jenkins.cloudstack.org/job/build-4=
.0-rhel63/
- Manually install jsvc package
- On mgmt server, check selinux policy
- Reinstall database, drop old databases and grant privileges (optiional)
- Agent is installed
- virt daemon is restarted and is running
- kvm modules are loaded as Wido suggests

I tested with 159, basic zone. Works for me.

On 25-Sep-2012, at 2:28 PM, Abhinav Roy <abhinav.roy@citrix.com<mailto:abhi=
nav.roy@citrix.com>> wrote:


Hi,

While adding a KVM host (Rhel 6.3) to the management server we are getting =
this error and the addition of host fails:

2012-09-25 12:35:14,214 INFO  [cloud.resource.ResourceManagerImpl] (catalin=
a-exec-17:null) Trying to add a new host athttp://10.102.125.13 in data cen=
ter 1
2012-09-25 12:35:14,594 DEBUG [utils.ssh.SSHCmdHelper] (catalina-exec-17:nu=
ll) Executing cmd: lsmod|grep kvm
2012-09-25 12:35:16,759 DEBUG [utils.ssh.SSHCmdHelper] (catalina-exec-17:nu=
ll) Executing cmd: lsmod|grep kvm
2012-09-25 12:35:18,818 DEBUG [utils.ssh.SSHCmdHelper] (catalina-exec-17:nu=
ll) Executing cmd: lsmod|grep kvm
2012-09-25 12:35:20,875 DEBUG [kvm.discoverer.KvmServerDiscoverer] (catalin=
a-exec-17:null) It's not a KVM enabled machine
2012-09-25 12:35:20,876 WARN  [cloud.resource.ResourceManagerImpl] (catalin=
a-exec-17:null) Unable to find the server resources at http://10.102.125.13
2012-09-25 12:35:20,877 WARN  [api.commands.AddHostCmd] (catalina-exec-17:n=
ull) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
        at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(Resourc=
eManagerImpl.java:737)
        at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceMan=
agerImpl.java:544)
        at com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138)
        at com.cloud.api.ApiServer.queueCommand(ApiServer.java:543)
        at com.cloud.api.ApiServer.handleRequest(ApiServer.java:422)
        at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:304)
        at com.cloud.api.ApiServlet.doGet(ApiServlet.java:63)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter=
(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(Applica=
tionFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWra=
pperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardCon=
textValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostVa=
lve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportVa=
lve.java:102)
        at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.=
java:555)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngi=
neValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapte=
r.java:298)
        at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioPro=
cessor.java:889)
        at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandl=
er.process(Http11NioProtocol.java:721)
        at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEn=
dpoint.java:2268)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec=
utor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe=
cutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
2012-09-25 12:35:20,879 WARN  [cloud.api.ApiDispatcher] (catalina-exec-17:n=
ull) class com.cloud.api.ServerApiException : Unable to add the host
2012-09-25 12:35:30,140 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] =
(consoleproxy-1:null) Skip capacity scan due to there is no Primary Storage=
 UPintenance mode
2012-09-25 12:35:30,667 DEBUG [network.router.VirtualNetworkApplianceManage=
rImpl] (RouterStatusMonitor-1:null) Found 0 routers.
2012-09-25 12:35:37,395 INFO  [cloud.resource.ResourceManagerImpl] (catalin=
a-exec-19:null) Trying to add a new host athttp://10.102.125.13 in data cen=
ter 1
2012-09-25 12:35:37,543 DEBUG [utils.ssh.SSHCmdHelper] (catalina-exec-19:nu=
ll) Executing cmd: lsmod|grep kvm
2012-09-25 12:35:39,694 DEBUG [utils.ssh.SSHCmdHelper] (catalina-exec-19:nu=
ll) Executing cmd: lsmod|grep kvm
2012-09-25 12:35:41,751 DEBUG [utils.ssh.SSHCmdHelper] (catalina-exec-19:nu=
ll) Executing cmd: lsmod|grep kvm
2012-09-25 12:35:43,807 DEBUG [kvm.discoverer.KvmServerDiscoverer] (catalin=
a-exec-19:null) It's not a KVM enabled machine
2012-09-25 12:35:43,807 WARN  [cloud.resource.ResourceManagerImpl] (catalin=
a-exec-19:null) Unable to find the server resources at http://10.102.125.13
2012-09-25 12:35:43,808 WARN  [api.commands.AddHostCmd] (catalina-exec-19:n=
ull) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
        at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(Resourc=
eManagerImpl.java:737)
        at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceMan=
agerImpl.java:544)
        at com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138)
        at com.cloud.api.ApiServer.queueCommand(ApiServer.java:543)
        at com.cloud.api.ApiServer.handleRequest(ApiServer.java:422)
        at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:304)
        at com.cloud.api.ApiServlet.doGet(ApiServlet.java:63)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter=
(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(Applica=
tionFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWra=
pperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardCon=
textValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostVa=
lve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportVa=
lve.java:102)
        at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.=
java:555)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngi=
neValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapte=
r.java:298)
        at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioPro=
cessor.java:889)
        at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandl=
er.process(Http11NioProtocol.java:721)
        at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEn=
dpoint.java:2268)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec=
utor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe=
cutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
2012-09-25 12:35:43,810 WARN  [cloud.api.ApiDispatcher] (catalina-exec-19:n=
ull) class com.cloud.api.ServerApiException : Unable to add the host
2012-09-25 12:35:44,697 DEBUG [cloud.server.StatsCollector] (StatsCollector=
-2:null) HostStatsCollector is running...
2012-09-25 12:35:44,707 DEBUG [cloud.server.StatsCollector] (StatsCollector=
-3:null) VmStatsCollector is running...
2012-09-25 12:35:44,708 DEBUG [cloud.server.StatsCollector] (StatsCollector=
-1:null) StorageCollector is running...


But when we restart the host and add again then the host gets added and we =
don't see any such error. We have seen this consistently with last few ASF =
builds.
Is this an expected behavior??

Environment :
Management server  : Rhel 6.3
Host : KVM (Rhel 6.3)
ASF build : [Git Revision: dec69146cac7c064e2596a1a13c86015f0c4cd0a Git URL=
: https://git-wip-us.apache.org/repos/asf/incubator-cloudstack.git]<https:/=
/git-wip-us.apache.org/repos/asf/incubator-cloudstack.git%5d> -------------=
-----  http://jenkins.cloudstack.org/job/build-4.0-rhel63/lastSuccessfulBui=
ld/artifact/CloudStack-oss-4.0.0-156.tar.bz2

<management-server.log><agent.log><api-server.log>


--_000_4FCA39B99132DA4EA70BE3CE408C193D01103A2114CEBANPMAILBOX_--