cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dsclose (JIRA)" <>
Subject [jira] [Created] (CLOUDSTACK-9024) Restart network fails if redundant router is missing
Date Tue, 03 Nov 2015 18:08:27 GMT
dsclose created CLOUDSTACK-9024:

             Summary: Restart network fails if redundant router is missing
                 Key: CLOUDSTACK-9024
             Project: CloudStack
          Issue Type: Bug
      Security Level: Public (Anyone can view this level - this is the default.)
          Components: API, Network Controller, Virtual Router
    Affects Versions: 4.5.2
         Environment: Cloudstack installed on CentOS 6.5
            Reporter: dsclose

Restart network action fails if a network is missing a redundant virtual router. This occurs
if triggered via the UI (Networks -> Select Network -> Restart -> Clean-ip: False
-> OK) or via the API.

Steps to reproduce:
1. Create a redundant router network offering.
2. Create a network using the redundant router network offering.
3. Destroy a redundant router from the network. Leave one functioning.
4. Initiate the restart network action or restartNetwork API call with clean-up set to False.

Expected Behaviour:
Cloudstack should boot a new redundant virtual router to replace the missing router. The Network
Restart action should return successfully.

Actual Behaviour:
Cloudstack boots a replacement redundant router but the API call returns unsucessful. The
Web UI reports that the router fails.

2015-11-03 17:12:08,256 Destroying router "r-985-VM".
2015-11-03 17:12:24,511 Performing network restart.
2015-11-03 17:14:02,851 Failed to restart network

Management Log Sample
2015-11-03 17:12:14,943 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-12:ctx-a671c200
job-163/job-164) Remove job-164 from job monitoring
2015-11-03 17:12:15,739 INFO  [o.a.c.s.v.VolumeServiceImpl] (API-Job-Executor-12:ctx-33b24483
job-163 ctx-4d95a357) Volume 985 is not referred anywhere, remove it from volumes table
2015-11-03 17:12:15,850 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-12:ctx-33b24483
job-163) Remove job-163 from job monitoring
2015-11-03 17:12:18,698 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-13:ctx-c29ad7f0
job-165) Add job-165 into job monitoring
2015-11-03 17:12:18,985 INFO  [c.c.n.r.VirtualNetworkApplianceManagerImpl] (API-Job-Executor-13:ctx-c29ad7f0
job-165 ctx-7945f6f9) Use same MAC as previous RvR, the MAC is 06:9c:86:00:00:0e
2015-11-03 17:12:19,829 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-13:ctx-06672650
job-165/job-166) Add job-166 into job monitoring
2015-11-03 17:12:20,078 INFO  [c.c.s.StorageManagerImpl] (Work-Job-Executor-13:ctx-06672650
job-165/job-166 ctx-81c163bb) Storage pool null (1) does not supply IOPS capacity, assuming
enough capacity
2015-11-03 17:12:40,248 INFO  [c.c.v.VirtualMachineManagerImpl] (DirectAgentCronJob-492:ctx-1fb6ecea)
There is pending job or HA tasks working on the VM. vm id: 992, postpone power-change report
by resetting power-change counters
2015-11-03 17:13:40,384 INFO  [c.c.v.VirtualMachineManagerImpl] (DirectAgentCronJob-280:ctx-846ef4f0)
There is pending job or HA tasks working on the VM. vm id: 992, postpone power-change report
by resetting power-change counters
2015-11-03 17:13:49,799 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10ff7f5f)
Begin cleanup expired async-jobs
2015-11-03 17:13:49,825 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10ff7f5f)
End cleanup expired async-jobs
2015-11-03 17:13:55,688 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-13:ctx-06672650
job-165/job-166) Remove job-166 from job monitoring
2015-11-03 17:13:55,730 WARN  [o.a.c.e.o.NetworkOrchestrator] (API-Job-Executor-13:ctx-c29ad7f0
job-165 ctx-7945f6f9) Failed to implement network Ntwk[208|Guest|15] elements and resources
as a part of network restart due to Resource [DataCenter:1] is unreachable:
Can't find all necessary running routers!
        at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(
        at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restartNetwork(
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(
        at java.lang.reflect.Method.invoke(
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(
        at com.sun.proxy.$Proxy157.restartNetwork(Unknown Source)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable$
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(
        at java.util.concurrent.Executors$
        at java.util.concurrent.ThreadPoolExecutor.runWorker(
        at java.util.concurrent.ThreadPoolExecutor$
2015-11-03 17:13:55,732 WARN  [c.c.n.NetworkServiceImpl] (API-Job-Executor-13:ctx-c29ad7f0
job-165 ctx-7945f6f9) Network id=208 failed to restart.
2015-11-03 17:13:55,806 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-13:ctx-c29ad7f0
job-165) Remove job-165 from job monitoring
2015-11-03 17:14:00,988 INFO  [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RedundantRouterStatusMonitor-7:ctx-5a3246e2)
Redundant virtual router (name: r-992-VM, id: 992)  just switch from UNKNOWN to BACKUP

This message was sent by Atlassian JIRA

View raw message