cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhinandan Prateek (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CLOUDSTACK-4597) Complete Exceptions are getting displayed in the UI where there is an operational failure (Ex: Live Storage migration failure)
Date Mon, 02 Dec 2013 06:51:35 GMT

     [ https://issues.apache.org/jira/browse/CLOUDSTACK-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Abhinandan Prateek updated CLOUDSTACK-4597:
-------------------------------------------

    Priority: Critical  (was: Major)

> Complete Exceptions are getting displayed in the UI where there is an operational failure
(Ex: Live Storage migration failure)
> ------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-4597
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4597
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: Management Server
>    Affects Versions: 4.2.1
>            Reporter: Sailaja Mada
>            Assignee: Damodar Reddy T
>            Priority: Critical
>             Fix For: 4.3.0
>
>         Attachments: ExceptionsintheUI.png
>
>
> Steps:
> 1. Configure Adv zone with 2 VMWARE clusters (Cluster level Primary storage)
> 2. Deploy instance 
> 3. Live Storage migrate this instance from cluster1 to Cluster2.
> Observation:
> 1. Live Storage Migration failed with operation timed out failures.
> 2. But the complete exception displayed in the UI instead of saying failed to migrate.
> 2013-09-02 23:16:34,426 WARN  [vmware.resource.VmwareResource] (DirectAgent-471:10.102.192.20)
MigrationCommand failed due to Exception: javax.xml.ws.WebServiceException
> Message: java.net.SocketTimeoutException: Read timed out
> javax.xml.ws.WebServiceException: java.net.SocketTimeoutException: Read timed out
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:201)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:151)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:83)
>         at com.sun.xml.internal.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:78)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.__doRun(Fiber.java:587)
>         at com.sun.xml.internal.ws.api.pipe.Fiber._doRun(Fiber.java:546)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.doRun(Fiber.java:531)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.runSync(Fiber.java:428)
>         at com.sun.xml.internal.ws.client.Stub.process(Stub.java:211)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.doProcess(SEIStub.java:124)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:98)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
>         at $Proxy89.waitForUpdates(Unknown Source)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForValues(VmwareClient.java:428)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForTask(VmwareClient.java:371)
>         at com.cloud.hypervisor.vmware.mo.VirtualMachineMO.changeDatastore(VirtualMachineMO.java:344)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4281)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:467)
>         at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> Caused by: java.net.SocketTimeoutException: Read timed out
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.read(SocketInputStream.java:146)
>         at sun.security.ssl.InputRecord.readFully(InputRecord.java:312)
>         at sun.security.ssl.InputRecord.read(InputRecord.java:350)
>  at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:850)
>         at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:807)
>         at sun.security.ssl.AppInputStream.read(AppInputStream.java:94)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
>         at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:688)
>         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:633)
>         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1162)
>         at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:397)
>         at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:198)
>         ... 27 more
> 2013-09-02 23:16:34,438 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-471:null)
Seq 1-693897219: Response Received:
> 2013-09-02 23:16:34,438 DEBUG [agent.transport.Request] (DirectAgent-471:null) Seq 1-693897219:
Processing:  { Ans: , MgmtId: 227594284004867, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.MigrateWithStorageAnswer":{"result":false,"details":"Exception:
javax.xml.ws.WebServiceException\nMessage: java.net.SocketTimeoutException: Read timed out\nStack:
javax.xml.ws.WebServiceException: java.net.SocketTimeoutException: Read timed out\n\tat com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:201)\n\tat
com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:151)\n\tat
com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:83)\n\tat
com.sun.xml.internal.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:78)\n\tat
com.sun.xml.internal.ws.api.pipe.Fiber.__doRun(Fiber.java:587)\n\tat com.sun.xml.internal.ws.api.pipe.Fiber._doRun(Fiber.java:546)\n\tat
com.sun.xml.internal.ws.api.pipe.Fiber.doRun(Fiber.java:531)\n\tat com.sun.xml.internal.ws.api.pipe.Fiber.runSync(Fiber.java:428)\n\tat
com.sun.xml.internal.ws.client.Stub.process(Stub.java:211)\n\tat com.sun.xml.internal.ws.client.sei.SEIStub.doProcess(SEIStub.java:124)\n\tat
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:98)\n\tat
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)\n\tat
com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)\n\tat $Proxy89.waitForUpdates(Unknown
Source)\n\tat com.cloud.hypervisor.vmware.util.VmwareClient.waitForValues(VmwareClient.java:428)\n\tat
com.cloud.hypervisor.vmware.util.VmwareClient.waitForTask(VmwareClient.java:371)\n\tat com.cloud.hypervisor.vmware.mo.VirtualMachineMO.changeDatastore(VirtualMachineMO.java:344)\n\tat
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4281)\n\tat
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:467)\n\tat
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)\n\tat
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:166)\n\tat
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)\n\tat
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)\n\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat
java.lang.Thread.run(Thread.java:679)\nCaused by: java.net.SocketTimeoutException: Read timed
out\n\tat java.net.SocketInputStream.socketRead0(Native Method)\n\tat java.net.SocketInputStream.read(SocketInputStream.java:146)\n\tat
sun.security.ssl.InputRecord.readFully(InputRecord.java:312)\n\tat sun.security.ssl.InputRecord.read(InputRecord.java:350)\n\tat
sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:850)\n\tat sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:807)\n\tat
sun.security.ssl.AppInputStream.read(AppInputStream.java:94)\n\tat java.io.BufferedInputStream.fill(BufferedInputStream.java:235)\n\tat
java.io.BufferedInputStream.read1(BufferedInputStream.java:275)\n\tat java.io.BufferedInputStream.read(BufferedInputStream.java:334)\n\tat
sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:688)\n\tat sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:633)\n\tat
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1162)\n\tat
java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:397)\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)\n\tat
com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:198)\n\t...
27 more\n","wait":0}}] }
> 2013-09-02 23:16:34,438 DEBUG [agent.transport.Request] (Job-Executor-99:job-175 = [
ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Seq 1-693897219: Received:  { Ans: , MgmtId: 227594284004867,
via: 1, Ver: v1, Flags: 110, { MigrateWithStorageAnswer } }
> 2013-09-02 23:16:34,439 ERROR [storage.motion.VmwareStorageMotionStrategy] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Migration with storage of vm VM[User|instance5]
failed. Details: Exception: javax.xml.ws.WebServiceException
> Message: java.net.SocketTimeoutException: Read timed out
> Stack: javax.xml.ws.WebServiceException: java.net.SocketTimeoutException: Read timed
out
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:201)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:151)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:83)
>         at com.sun.xml.internal.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:78)
>  at com.sun.xml.internal.ws.api.pipe.Fiber.__doRun(Fiber.java:587)
>         at com.sun.xml.internal.ws.api.pipe.Fiber._doRun(Fiber.java:546)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.doRun(Fiber.java:531)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.runSync(Fiber.java:428)
>         at com.sun.xml.internal.ws.client.Stub.process(Stub.java:211)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.doProcess(SEIStub.java:124)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:98)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
>         at $Proxy89.waitForUpdates(Unknown Source)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForValues(VmwareClient.java:428)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForTask(VmwareClient.java:371)
>         at com.cloud.hypervisor.vmware.mo.VirtualMachineMO.changeDatastore(VirtualMachineMO.java:344)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4281)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:467)
>         at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> Caused by: java.net.SocketTimeoutException: Read timed out
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.read(SocketInputStream.java:146)
>         at sun.security.ssl.InputRecord.readFully(InputRecord.java:312)
>         at sun.security.ssl.InputRecord.read(InputRecord.java:350)
>         at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:850)
>         at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:807)
>         at sun.security.ssl.AppInputStream.read(AppInputStream.java:94)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
>         at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:688)
>         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:633)
>         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1162)
>         at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:397)
>         at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:198)
> ... 27 more
> 2013-09-02 23:16:34,439 ERROR [storage.motion.VmwareStorageMotionStrategy] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) copy failed
> com.cloud.utils.exception.CloudRuntimeException: Error while migrating the vm VM[User|instance5]
to host Host[-8-Routing]. Exception: javax.xml.ws.WebServiceException
> Message: java.net.SocketTimeoutException: Read timed out
> Stack: javax.xml.ws.WebServiceException: java.net.SocketTimeoutException: Read timed
out
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:201)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:151)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:83)
>         at com.sun.xml.internal.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:78)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.__doRun(Fiber.java:587)
>         at com.sun.xml.internal.ws.api.pipe.Fiber._doRun(Fiber.java:546)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.doRun(Fiber.java:531)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.runSync(Fiber.java:428)
>         at com.sun.xml.internal.ws.client.Stub.process(Stub.java:211)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.doProcess(SEIStub.java:124)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:98)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
>         at $Proxy89.waitForUpdates(Unknown Source)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForValues(VmwareClient.java:428)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForTask(VmwareClient.java:371)
>         at com.cloud.hypervisor.vmware.mo.VirtualMachineMO.changeDatastore(VirtualMachineMO.java:344)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4281)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:467)
>         at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> Caused by: java.net.SocketTimeoutException: Read timed out
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.read(SocketInputStream.java:146)
>         at sun.security.ssl.InputRecord.readFully(InputRecord.java:312)
>         at sun.security.ssl.InputRecord.read(InputRecord.java:350)
>         at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:850)
>         at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:807)
>  at sun.security.ssl.AppInputStream.read(AppInputStream.java:94)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
>         at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:688)
>         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:633)
>         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1162)
>         at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:397)
>         at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:198)
>         ... 27 more
>         at org.apache.cloudstack.storage.motion.VmwareStorageMotionStrategy.migrateVmWithVolumesAcrossCluster(VmwareStorageMotionStrategy.java:140)
>         at org.apache.cloudstack.storage.motion.VmwareStorageMotionStrategy.copyAsync(VmwareStorageMotionStrategy.java:99)
>         at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:67)
>         at org.apache.cloudstack.storage.volume.VolumeServiceImpl.migrateVolumes(VolumeServiceImpl.java:975)
>         at com.cloud.storage.VolumeManagerImpl.migrateVolumes(VolumeManagerImpl.java:2311)
>         at com.cloud.vm.VirtualMachineManagerImpl.migrateWithStorage(VirtualMachineManagerImpl.java:1785)
>         at com.cloud.vm.UserVmManagerImpl.migrateVirtualMachineWithVolume(UserVmManagerImpl.java:4334)
>         at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>         at org.apache.cloudstack.api.command.admin.vm.MigrateVirtualMachineWithVolumeCmd.execute(MigrateVirtualMachineWithVolumeCmd.java:137)
>         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>         at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> 2013-09-02 23:16:34,444 DEBUG [agent.manager.AgentAttache] (DirectAgent-471:null) Seq
1-693897219: No more commands found
> 2013-09-02 23:16:34,453 WARN  [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@6c0e620b),
no need to delete from object in store ref table
> 2013-09-02 23:16:34,466 WARN  [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@2877c851),
no need to delete from object in store ref table
> 2013-09-02 23:16:34,480 WARN  [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@333bbd65),
no need to delete from object in store ref table
> 2013-09-02 23:16:34,491 WARN  [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@63e02aa0),
no need to delete from object in store ref table
> 2013-09-02 23:16:34,491 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Failed to migrated vm VM[User|instance5] along
with its volumes. com.cloud.utils.exception.CloudRuntimeException: Error while migrating the
vm VM[User|instance5] to host Host[-8-Routing]. Exception: javax.xml.ws.WebServiceException
> Message: java.net.SocketTimeoutException: Read timed out
> Stack: javax.xml.ws.WebServiceException: java.net.SocketTimeoutException: Read timed
out
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:201)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:151)
>         at com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:83)
>         at com.sun.xml.internal.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:78)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.__doRun(Fiber.java:587)
>  at com.sun.xml.internal.ws.api.pipe.Fiber._doRun(Fiber.java:546)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.doRun(Fiber.java:531)
>         at com.sun.xml.internal.ws.api.pipe.Fiber.runSync(Fiber.java:428)
>         at com.sun.xml.internal.ws.client.Stub.process(Stub.java:211)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.doProcess(SEIStub.java:124)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:98)
>         at com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
>         at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
>         at $Proxy89.waitForUpdates(Unknown Source)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForValues(VmwareClient.java:428)
>         at com.cloud.hypervisor.vmware.util.VmwareClient.waitForTask(VmwareClient.java:371)
>         at com.cloud.hypervisor.vmware.mo.VirtualMachineMO.changeDatastore(VirtualMachineMO.java:344)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4281)
>         at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:467)
>         at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> Caused by: java.net.SocketTimeoutException: Read timed out
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.read(SocketInputStream.java:146)
>         at sun.security.ssl.InputRecord.readFully(InputRecord.java:312)
>         at sun.security.ssl.InputRecord.read(InputRecord.java:350)
>         at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:850)
>         at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:807)
>         at sun.security.ssl.AppInputStream.read(AppInputStream.java:94)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
>         at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:688)
>         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:633)
>         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1162)
>         at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:397)
>         at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>         at com.sun.xml.internal.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:198)
>         ... 27 more
> 2013-09-02 23:16:34,491 INFO  [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Migration was unsuccessful.  Cleaning up: VM[User|instance5]
> 2013-09-02 23:16:34,491 WARN  [apache.cloudstack.alerts] (Job-Executor-99:job-175 = [
ca1a7028-1aac-44c0-9833-96cb9f911cde ])  alertType:: 17 // dataCenterId:: 1 // podId:: 1 //
clusterId:: null // message:: Unable to migrate vm i-3-8-VM from host 10.102.192.20 in zone
zone307 and pod zone307
> 2013-09-02 23:16:34,494 DEBUG [cloud.alert.AlertManagerImpl] (Job-Executor-99:job-175
= [ ca1a7028-1aac-44c0-9833-96cb9f911cde ]) Have already sent: 1 emails for alert type '17'
-- skipping sen



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message