cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhinandan Prateek <abhinandan.prat...@shapeblue.com>
Subject Re: Recurring snapshot taking full every time
Date Mon, 21 Sep 2015 05:16:38 GMT
Looking at the code the plugin that is failing is “vmopsSnapshot”. That will mean the snapshot
operation is falling possibly due to lack of space.
You have mentioned that you are running out of space. Did you try freeing up some space ?


> On 18-Sep-2015, at 12:14 pm, raja sekhar <rajsekhar.467@gmail.com> wrote:
>
> Hi Abhinandan,
>
> I have force reconnect the hosts but no use and i didn't find any error in
> SMlog. please suggest me the error is still
> generating.
>
> Regards,
> Rajasekhar.
>
> On Wed, Sep 16, 2015 at 8:58 AM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
>> Can you check in the SMlog on the concerned host if you see any error when
>> the plugin is being invoked ?
>>
>>> On 14-Sep-2015, at 5:01 pm, raja sekhar <rajsekhar.467@gmail.com> wrote:
>>>
>>> Hi abhinandan,
>>>
>>> Thanks for your reply.
>>> We are facing the issue only for root volumes in that host. The snapshot
>>> recurring policy for data disks in same host is working fine.
>>> if the host configuration is not properly instrumented the policy for
>> data
>>> disks also fails, but it is working fine.
>>> please suggest us.
>>>
>>> Note: The manual snapshots for root disk is working fine,and it is taking
>>> child when second manual is configured , problem only with root daily
>>> snapshots every day it is taking full instead of taking child snapshots
>>> throwing error "*Failed to get parent snapshot**, due to There was a
>>> failure communicating with the plugin*".
>>>
>>> Regards,
>>> rajasekhar.
>>>
>>> On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
>>> abhinandan.prateek@shapeblue.com> wrote:
>>>
>>>> Looks like the host is not instrumented properly and management server
>> is
>>>> unable to invoke plugin on the host.
>>>> Can you force-reconnect the host that is throwing this error ? That
>> should
>>>> recopy the plugins on to the host.
>>>>
>>>>> On 14-Sep-2015, at 3:15 pm, raja sekhar <rajsekhar.467@gmail.com>
>> wrote:
>>>>>
>>>>> Hi All,
>>>>>
>>>>> I am using CS 4.3.1 and xenserver 6.2
>>>>> I have configured daily recurring snapshot policy for all the root
>>>> volumes.
>>>>> but recent three days onwards it is taking full snapshots and not
>> taking
>>>>> any child snapshots.
>>>>> I have configured snapshot.delta.max to 16.
>>>>> please help me my secondary storage is becoming full.
>>>>>
>>>>> The log file details shows:
>>>>>
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
>>>>> Resp: Routing to peer
>>>>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>>>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
>>>>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>>>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
>>>> VM
>>>>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link]
>> (AgentManager-Selector:null)
>>>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>>>> continue.
>>>>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
>>>>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
>>>> MgmtId:
>>>>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
>>>>>
>>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>>>
>>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>>>
>>>>
>> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>>>
>>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>>
>> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
>>>>> }
>>>>> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
>>>>> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
>>>>> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
>>>> getVhdParent
>>>>> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
>>>>> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
>>>> to
>>>>> There was a failure communicating with the plugin.
>>>>> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
>>>>> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
>>>>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
>>>> for
>>>>> cmd: getVhdParent with args snapshotUuid:
>>>>> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
>>>> primaryStorageSRUuid:
>>>>> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
>>>>> communicating with the plugin.
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>>>>>      at
>>>>>
>>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>>>>>      at
>>>>>
>>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
>>>>> at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>>>>>      at
>>>>>
>>>>
>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>>>      at
>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>>>      at
>>>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>>>>      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>>      at java.lang.Thread.run(Thread.java:701)
>>>>> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
>>>>> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
>>>>> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
>>>>> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
>>>>> 108371418365724, via: 1, Ver: v1, Flags: 10,
>>>>>
>>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
>>>>> }
>>>>> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link]
>> (AgentManager-Selector:null)
>>>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>>>> continue.
>>>>> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
>>>>> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
>>>> {
>>>>> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
>>>>>
>>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
>>>>> \"connections\": []\n}","wait":0}}] }
>>>>>
>>>>>
>>>>> Regards,
>>>>> rajasekhar.
>>>>
>>>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>>>
>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/
>>>
>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>
>>>> This email and any attachments to it may be confidential and are
>> intended
>>>> solely for the use of the individual to whom it is addressed. Any views
>> or
>>>> opinions expressed are solely those of the author and do not necessarily
>>>> represent those of Shape Blue Ltd or related companies. If you are not
>> the
>>>> intended recipient of this email, you must neither take any action based
>>>> upon its contents, nor copy or show it to anyone. Please contact the
>> sender
>>>> if you believe you have received this email in error. Shape Blue Ltd is
>> a
>>>> company incorporated in England & Wales. ShapeBlue Services India LLP
>> is a
>>>> company incorporated in India and is operated under license from Shape
>> Blue
>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
>> Brasil
>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
>> is
>>>> a company registered by The Republic of South Africa and is traded under
>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use
of the individual to whom it is addressed. Any views or opinions expressed are solely those
of the author and do not necessarily represent those of Shape Blue Ltd or related companies.
If you are not the intended recipient of this email, you must neither take any action based
upon its contents, nor copy or show it to anyone. Please contact the sender if you believe
you have received this email in error. Shape Blue Ltd is a company incorporated in England
& Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company
registered by The Republic of South Africa and is traded under license from Shape Blue Ltd.
ShapeBlue is a registered trademark.
Mime
View raw message