cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dag Sonstebo <Dag.Sonst...@shapeblue.com>
Subject Re: KVM + CentOS 7.2 + after connection agent state for long time in alert mode
Date Mon, 21 Nov 2016 13:37:24 GMT
For completeness sake – this issue was traced back to a potential issue with OpenJDK 1.8.
Once host was downgraded to OpenJDK 1.7 the issue seemed to be resolved.

Sven – if I missed any steps you carried out can you update?

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 15/11/2016, 10:52, "Vogel, Sven" <Sven.Vogel@kupper-computer.com> wrote:

    Hi,
    
    i already opened a bug report in jira. https://issues.apache.org/jira/browse/CLOUDSTACK-9590
    
    maybe anyone in mailing list can help.
    
    
    1. first of all i add the host from cs management
    2. Management Host cloudstack-setup-agent  -m 192.168.85.25 -z 3 -p 3 -c 9 -g 6e6cff15-3183-3cca-9389-ed1a78f6236a
-a --pubNic=cloudbr2 --prvNic=cloudbr0 --guestNic=cloudbr1 --hypervisor=kvm
    3. agent will be dead after add to the host
    4. restart agent
    6. agent reconnect to server and wait with alert
    
    In cs manager I get the following error.
    
    
    2016-11-14 16:44:56,034 WARN  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Monitor NetworkOrchestrator says there is an error in the connect process
for 70 due to Unable to get an answer to the Check
    
    NetworkCommand from agent: 70
    
    2016-11-14 16:44:56,034 INFO  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Host 70 is disconnecting with event AgentDisconnected
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) The next status of agent 70is Alert, current status is Connecting
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Deregistering link for 70 with state Alert
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Remove Agent : 70
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.ConnectedAgentAttache] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Processing Disconnect.
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.xenserver.discoverer.XcpServerDiscoverer
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.deploy.DeploymentPlanningManagerImpl
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: org.apache.cloudstack.engine.orchestration.NetworkOrchestrator
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.n.NetworkUsageManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Disconnected called on 70 with status Alert
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener
    
    2016-11-14 16:44:56,043 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener
    
    2016-11-14 16:44:56,044 DEBUG [c.c.h.Status] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e)
Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id = 70, name
= kvm03.oscloud.local]
    
    2016-11-14 16:44:56,054 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Notifying other nodes of to disconnect
    
    2016-11-14 16:44:56,060 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Failed to handle host connection: com.cloud.exception.ConnectionException:
Unable to get an answer to the CheckNetworkCommand from agent: 70
    
    2016-11-14 16:44:56,064 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f)
(logid:6cdf713e) Can not send command com.cloud.agent.api.ReadyCommand due to Host 70 is not
up
    
    2016-11-14 16:44:58,384 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null)
(logid:) SeqA 39-159363: Processing Seq 39-159363:  { Cmd , MgmtId: -1, via: 39, Ver: v1,
Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":13179,"_loadInfo":"{\n
 \"connections\": []\n}","wait":0}}] }
    
    2016-11-14 16:44:58,394 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null)
(logid:) SeqA 39-159363: Sending Seq 39-159363:  { Ans: , MgmtId: 3232257305, via: 39, Ver:
v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
    
    I don't know why he cant get the check networkcommand.
    
    Anyone can help me?
    
    regards,
    Sven Vogel
    
    
    


Dag.Sonstebo@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Mime
View raw message