cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rayees Namathponnan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CLOUDSTACK-4540) [Automation] Parallel deployment - Vmware - When deploying 30 parallel Vms , 16 Vms fails to get deployed due to "VmDataCommand failed due to Exception: java.lang.Exception Message: Timed out in waiting SSH execution result"
Date Tue, 10 Dec 2013 20:46:07 GMT

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13844648#comment-13844648
] 

Rayees Namathponnan commented on CLOUDSTACK-4540:
-------------------------------------------------





2013-12-10 00:05:20,690 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-66:ctx-d8f0044f) Seq
3-1677066854: Executing request
2013-12-10 00:05:20,710 ERROR [c.c.u.s.SshHelper] (DirectAgent-68:ctx-e37c70a2 10.223.250.130)
Timed out in waiting SSH execution result
2013-12-10 00:05:20,710 ERROR [c.c.h.v.r.VmwareResource] (DirectAgent-68:ctx-e37c70a2 10.223.250.130)
Unable to execute NetworkUsage command on DomR (10.223.250.181), domR may not be ready ye
t. failure due to Exception: java.lang.Exception
Message: Timed out in waiting SSH execution result

java.lang.Exception: Timed out in waiting SSH execution result
        at com.cloud.utils.ssh.SshHelper.sshExecute(SshHelper.java:166)
        at com.cloud.utils.ssh.SshHelper.sshExecute(SshHelper.java:37)
        at com.cloud.hypervisor.vmware.resource.VmwareResource.networkUsage(VmwareResource.java:6580)
        at com.cloud.hypervisor.vmware.resource.VmwareResource.getNetworkStats(VmwareResource.java:6596)
        at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:672)
        at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:505)
        at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)
2013-12-10 00:05:20,711 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-68:ctx-e37c70a2) Seq
2-34473755: Response Received:
2013-12-10 00:05:20,711 DEBUG [c.c.a.t.Request] (DirectAgent-68:ctx-e37c70a2) Seq 2-34473755:
Processing:  { Ans: , MgmtId: 90928106758026, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.
NetworkUsageAnswer":{"routerName":"r-156-VM","bytesSent":0,"bytesReceived":0,"result":true,"details":"","wait":0}}]
}
2013-12-10 00:05:20,712 DEBUG [c.c.a.t.Request] (RouterMonitor-1:ctx-8e9a7d8a) Seq 2-34473755:
Received:  { Ans: , MgmtId: 90928106758026, via: 2, Ver: v1, Flags: 10, { NetworkUsageAnswer
} }
2013-12-10 00:05:20,712 DEBUG [c.c.a.m.AgentManagerImpl] (RouterMonitor-1:ctx-8e9a7d8a) Details
from executing class com.cloud.agent.api.NetworkUsageCommand:
2013-12-10 00:05:20,712 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:ctx-8e9a7d8a)
Recieved and Sent bytes are both 0. Not updating user_statistics
2013-12-10 00:05:20,721 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-177:ctx-19cf0d79)
Seq 1-669845282: Executing request
2013-12-10 00:05:20,721 INFO  [c.c.h.v.r.VmwareResource] (DirectAgent-177:ctx-19cf0d79 10.223.250.131)
Executing resource NetworkUsageComma

> [Automation] Parallel deployment - Vmware - When deploying 30 parallel Vms , 16 Vms fails
to get deployed due to "VmDataCommand failed due to Exception: java.lang.Exception Message:
Timed out in waiting SSH execution result"
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-4540
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4540
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: Management Server
>    Affects Versions: 4.2.0
>         Environment: Build from 4.2-forward.
>            Reporter: Sangeetha Hariharan
>            Assignee: Sheng Yang
>            Priority: Blocker
>             Fix For: 4.3.0
>
>         Attachments: management-server.log
>
>
> Parallel deployment - Vmware - When deploying 30 parallel Vms , 16 Vms fails to get deployed
due to "VmDataCommand failed due to Exception: java.lang.Exception
> Message: Timed out in waiting SSH execution result"
> Set up - Advanced zone with 1 Vmware 5.0.0 Esxi host.
> Deploy 30 Vms in parallel.
> 16 out of 30 vms deployed in parallel , failed due to "VmDataCommand failed due to Exception:
java.lang.Exception
> Message: Timed out in waiting SSH execution result"
> Following exception seen in Management server logs:
> 2013-08-28 10:26:58,939 ERROR [vmware.resource.VmwareResource] (DirectAgent-21:10.223.58.66)
VmDataCommand failed due to Exception: java.lang.Exception
> Message: Timed out in waiting SSH execution result
> java.lang.Exception: Timed out in waiting SSH execution result
>         at com.cloud.utils.ssh.SshHelper.sshExecute(SshHelper.java:166)
>         at com.cloud.utils.ssh.SshHelper.sshExecute(SshHelper.java:37)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2470)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:441)
>         at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> 2013-08-28 10:26:58,940 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-21:null)
Seq 1-170983503: Response Received:
> 2013-08-28 10:26:58,941 DEBUG [agent.transport.Request] (DirectAgent-21:null) Seq 1-170983503:
Processing:  { Ans: , MgmtId: 7083743249448, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand
failed due to Exception: java.lang.Exception\nMessage: Timed out in waiting SSH execution
result\n","wait":0}}] }
> 2013-08-28 10:26:58,941 DEBUG [agent.transport.Request] (Job-Executor-29:job-398 = [
b3a34f25-37b2-4f33-b183-c0ea348d7af9 ]) Seq 1-170983503: Received:  { Ans: , MgmtId: 7083743249448,
via: 1, Ver: v1, Flags: 10, { Answer, Answer } }
> 2013-08-28 10:26:58,979 INFO  [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-29:job-398
= [ b3a34f25-37b2-4f33-b183-c0ea348d7af9 ]) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable:
Unable to apply userdata and password entry on router
>         at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3808)
>         at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:2993)
>         at com.cloud.network.element.VirtualRouterElement.addPasswordAndUserdata(VirtualRouterElement.java:926)
>         at com.cloud.network.NetworkManagerImpl.prepareElement(NetworkManagerImpl.java:2076)
>         at com.cloud.network.NetworkManagerImpl.prepareNic(NetworkManagerImpl.java:2191)
>         at com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2127)
>         at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:886)
>         at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578)
>         at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:227)
>         at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
>         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3406)
>         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2966)
>         at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2952)
>         at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>         at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
>         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>         at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message