cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kirk Jantzer <kirk.jant...@gmail.com>
Subject Re: Unable to add rebuilt xenserver host
Date Fri, 22 Mar 2013 18:35:54 GMT
I get: "This server's network backend is different from the master's"


On Fri, Mar 22, 2013 at 2:30 PM, Jason Davis <scr512@gmail.com> wrote:

> Yeah had the same thought. Seems that the cluster master is balking. So
> yeah, try in XenCenter.
>
>
> On Fri, Mar 22, 2013 at 1:23 PM, Kirk Jantzer <kirk.jantzer@gmail.com
> >wrote:
>
> > You mean through Xen Center?
> >
> >
> > On Fri, Mar 22, 2013 at 2:19 PM, Ahmad Emneina <aemneina@gmail.com>
> wrote:
> >
> > > from the log snippet it seems the host cant join the cluster. can you
> try
> > > this out of band from cloudstack, join pool from the host, and see what
> > you
> > > get?
> > >
> > >
> > > On Fri, Mar 22, 2013 at 11:10 AM, Kirk Jantzer <kirk.jantzer@gmail.com
> > >wrote:
> > >
> > >> There's no entry for that host in host_details :-(
> > >>
> > >>
> > >> On Fri, Mar 22, 2013 at 1:30 PM, Ahmad Emneina <aemneina@gmail.com
> > >wrote:
> > >>
> > >>> have you looked at host_details? There should still be an entry with
> > the
> > >>> same host details. I'm not entirely sure if this is safe, but you
> might
> > >>> want to back up your db, then delete the entries for the problem host
> > >>> from
> > >>> both the cloud.host and cloud.host_details tables.
> > >>>
> > >>>
> > >>> On Fri, Mar 22, 2013 at 9:57 AM, Kirk Jantzer <
> kirk.jantzer@gmail.com
> > >>> >wrote:
> > >>>
> > >>> > Anybody?
> > >>> >
> > >>> >
> > >>> > On Thu, Mar 21, 2013 at 8:58 PM, Kirk Jantzer <
> > kirk.jantzer@gmail.com
> > >>> > >wrote:
> > >>> >
> > >>> > > I deleted the host from cloud.host, as well as any old guests
in
> > >>> > > cloud.vm_instance that had that host as last_host_id.
> > >>> > > On Mar 21, 2013 8:53 PM, "Jason Davis" <scr512@gmail.com>
wrote:
> > >>> > >
> > >>> > >> Not in front of my workstation but I bet the UUID in
the
> > cloud.host
> > >>> > >> portion
> > >>> > >> of the DB still exists even if it is marked "removed".
Easy way
> to
> > >>> fix
> > >>> > >> this
> > >>> > >> is to slightly change that UUID.
> > >>> > >> On Mar 21, 2013 2:34 PM, "Kirk Jantzer" <kirk.jantzer@gmail.com
> >
> > >>> wrote:
> > >>> > >>
> > >>> > >> > Background: I evicted a host from my cluster to
do some
> testing
> > >>> with
> > >>> > >> some
> > >>> > >> > other opensource products. When I was done, I reinstalled
XS
> as
> > I
> > >>> did
> > >>> > to
> > >>> > >> > all the other hosts, however I am unable to add
the host back
> to
> > >>> the
> > >>> > >> > cluster. I did find a post about duplicate entries
in the db,
> > so I
> > >>> > >> deleted
> > >>> > >> > the entry, but am still unable to add it. Thoughts?
> > >>> > >> >
> > >>> > >> > CS 4.0.1
> > >>> > >> > XenServer 6.0.2
> > >>> > >> >
> > >>> > >> > Output of /var/log/cloud/management/management-server.log:
> > >>> > >> >
> > >>> > >> > 2013-03-21 15:23:11,989 DEBUG [cloud.api.ApiServlet]
> > >>> > (http-8080-3:null)
> > >>> > >> > ===START===  <client_ipaddress> -- GET
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
>  command=addHost&zoneid=7551e0e8-5c64-4955-b368-cf497bd9fd16&podid=81151bfa-d519-4b1d-92ca-df7ce424460c&clusterid=9ec5ca37-df78-4910-b09f-d9be3bed2269&hypervisor=XenServer&clustertype=CloudManaged&hosttags=&username=root&url=http%3A%2F%2F<host_name>&response=json&sessionkey=LPR4A%2FAuwEtdUbF%2BdvSyLpg7rnA%3D&_=1363893870935
> > >>> > >> > 2013-03-21 15:23:12,001 INFO
> >  [cloud.resource.ResourceManagerImpl]
> > >>> > >> > (http-8080-3:null) Trying to add a new host at http://
> > <host_name>
> > >>> in
> > >>> > >> data
> > >>> > >> > center 1
> > >>> > >> > 2013-03-21 15:23:12,059 DEBUG
> > >>> [xen.resource.XenServerConnectionPool]
> > >>> > >> > (http-8080-3:null) Slave logon to <host_ipaddress>
> > >>> > >> > 2013-03-21 15:23:12,076 DEBUG
> > >>> [xen.resource.XenServerConnectionPool]
> > >>> > >> > (http-8080-3:null) Logging on as the master to
> <host_ipaddress>
> > >>> > >> > 2013-03-21 15:23:13,006 WARN
> > >>>  [xen.resource.XenServerConnectionPool]
> > >>> > >> > (http-8080-3:null) Catch
> > >>> > com.xensource.xenapi.Types$OperationNotAllowed
> > >>> > >> > Unable to allow host <host_ipaddress> to join
pool
> > >>> <master_ipaddress>
> > >>> > >> due
> > >>> > >> > to You attempted an operation that was not allowed.
> > >>> > >> > You attempted an operation that was not allowed.
> > >>> > >> >         at
> > >>> com.xensource.xenapi.Types.checkResponse(Types.java:1572)
> > >>> > >> >         at
> > >>> > com.xensource.xenapi.Connection.dispatch(Connection.java:368)
> > >>> > >> >         at com.xensource.xenapi.Pool.join(Pool.java:1054)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.join(XenServerConnectionPool.java:785)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.joinPool(XenServerConnectionPool.java:159)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.addHostsToPool(XcpServerDiscoverer.java:407)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.find(XcpServerDiscoverer.java:207)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:687)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:544)
> > >>> > >> >         at
> > >>> > >> com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140)
> > >>> > >> >         at
> > >>> > com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138)
> > >>> > >> >         at
> > >>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544)
> > >>> > >> >         at
> > >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423)
> > >>> > >> >         at
> > >>> > com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312)
> > >>> > >> >         at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64)
> > >>> > >> >         at
> > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > >>> > >> >         at
> > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
> > >>> > >> >         at
> > >>> > >> >
> > >>> >
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > >>> > >> >         at java.lang.Thread.run(Thread.java:679)
> > >>> > >> > 2013-03-21 15:23:13,007 DEBUG
> > >>> [xen.resource.XenServerConnectionPool]
> > >>> > >> > (http-8080-3:null) Host(<host_ipaddress>)
unable to Join the
> > pool
> > >>> at
> > >>> > >> > <master_ipaddress>
> > >>> > >> > 2013-03-21 15:23:13,007 WARN
> >  [xen.discoverer.XcpServerDiscoverer]
> > >>> > >> > (http-8080-3:null) Unable to join the pool
> > >>> > >> > 2013-03-21 15:23:13,007 DEBUG
> > [xen.discoverer.XcpServerDiscoverer]
> > >>> > >> > (http-8080-3:null) other exceptions:
> > >>> > >> > com.cloud.exception.DiscoveryException: Unable to
join the
> pool
> > >>> > >> > com.cloud.exception.DiscoveryException: Unable to
join the
> pool
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.addHostsToPool(XcpServerDiscoverer.java:409)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.find(XcpServerDiscoverer.java:207)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:687)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:544)
> > >>> > >> >         at
> > >>> > >> com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140)
> > >>> > >> >         at
> > >>> > com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138)
> > >>> > >> >         at
> > >>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544)
> > >>> > >> >         at
> > >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423)
> > >>> > >> >         at
> > >>> > com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312)
> > >>> > >> >         at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64)
> > >>> > >> >         at
> > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > >>> > >> >         at
> > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
> > >>> > >> >         at
> > >>> > >> >
> > >>> >
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > >>> > >> >         at java.lang.Thread.run(Thread.java:679)
> > >>> > >> > 2013-03-21 15:23:13,008 WARN
> >  [cloud.resource.ResourceManagerImpl]
> > >>> > >> > (http-8080-3:null) Unable to find the server resources
at
> > http://
> > >>> > >> > <host_name>
> > >>> > >> > 2013-03-21 15:23:13,008 WARN  [api.commands.AddHostCmd]
> > >>> > >> (http-8080-3:null)
> > >>> > >> > Exception:
> > >>> > >> > com.cloud.exception.DiscoveryException: Unable to
add the host
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:737)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:544)
> > >>> > >> >         at
> > >>> > >> com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140)
> > >>> > >> >         at
> > >>> > com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138)
> > >>> > >> >         at
> > >>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544)
> > >>> > >> >         at
> > >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423)
> > >>> > >> >         at
> > >>> > com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312)
> > >>> > >> >         at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64)
> > >>> > >> >         at
> > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > >>> > >> >         at
> > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > >>> > >> >         at
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
> > >>> > >> >         at
> > >>> > >> >
> > >>> >
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > >>> > >> >         at java.lang.Thread.run(Thread.java:679)
> > >>> > >> > 2013-03-21 15:23:13,008 WARN  [cloud.api.ApiDispatcher]
> > >>> > >> (http-8080-3:null)
> > >>> > >> > class com.cloud.api.ServerApiException : Unable
to add the
> host
> > >>> > >> > 2013-03-21 15:23:13,009 DEBUG [cloud.api.ApiServlet]
> > >>> > (http-8080-3:null)
> > >>> > >> > ===END===  <client_ipaddress> -- GET
> > >>> > >> >
> > >>> > >> >
> > >>> > >>
> > >>> >
> > >>>
> >
>  command=addHost&zoneid=7551e0e8-5c64-4955-b368-cf497bd9fd16&podid=81151bfa-d519-4b1d-92ca-df7ce424460c&clusterid=9ec5ca37-df78-4910-b09f-d9be3bed2269&hypervisor=XenServer&clustertype=CloudManaged&hosttags=&username=root&url=http%3A%2F%2F<host_name>&response=json&sessionkey=LPR4A%2FAuwEtdUbF%2BdvSyLpg7rnA%3D&_=1363893870935
> > >>> > >> >
> > >>> > >>
> > >>> > >
> > >>> >
> > >>> >
> > >>> > --
> > >>> > Regards,
> > >>> >
> > >>> > Kirk Jantzer
> > >>> > c: (678) 561-5475
> > >>> >
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> Regards,
> > >>
> > >> Kirk Jantzer
> > >> c: (678) 561-5475
> > >>
> > >
> > >
> >
> >
> > --
> > Regards,
> >
> > Kirk Jantzer
> > c: (678) 561-5475
> >
>



-- 
Regards,

Kirk Jantzer
c: (678) 561-5475

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message