Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6394C10C29 for ; Mon, 3 Nov 2014 06:27:34 +0000 (UTC) Received: (qmail 11525 invoked by uid 500); 3 Nov 2014 06:27:34 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 11487 invoked by uid 500); 3 Nov 2014 06:27:34 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 11474 invoked by uid 500); 3 Nov 2014 06:27:33 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 11471 invoked by uid 99); 3 Nov 2014 06:27:33 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Nov 2014 06:27:33 +0000 Date: Mon, 3 Nov 2014 06:27:33 +0000 (UTC) From: "Sanjay Tripathi (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CLOUDSTACK-6576) No Error Handling while deploying GPU unsupported instances on a GPU enabled host (Ex: Cent OS instance) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-6576?page=3Dcom.atla= ssian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= =3D14194296#comment-14194296 ]=20 Sanjay Tripathi commented on CLOUDSTACK-6576: --------------------------------------------- There is no need to fix anything here, XenServer is already giving proper e= rror message that GPU is not supprted for non-HVM guests. Also, the fix would add unnecessary check in the orchestration layer and ma= y cause issues in future if XS starts supporting non-HVM guestOS with GPU c= ompute offering. > No Error Handling while deploying GPU unsupported instances on a GPU enab= led host (Ex: Cent OS instance) > -------------------------------------------------------------------------= ------------------------------- > > Key: CLOUDSTACK-6576 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-657= 6 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Management Server, XenServer > Affects Versions: 4.4.0 > Reporter: Sailaja Mada > Assignee: Sanjay Tripathi > Priority: Minor > Fix For: 4.4.0, 4.5.0 > > Attachments: logs1.zip > > > Steps: > 1. Install and configure Adv zone with GPU enabled XenServer 6.2.5=20 > 2. Try to deploy default Cent OS instance using GPU enabled offering( K2= - 200 profile)=20 > Observation: > 1. Xenserver does not support vGPU with Linux instances. =20 > 2. Cloudstack throws deployment failure after throwing lot of exceptions= by XenServer. > Expected Results: > CloudStack should parse the failure provided by XS and provide proper dep= loyment failure as unsupported deployment. > 2014-05-05 16:38:50,730 DEBUG [c.c.a.t.Request] (Work-Job-Executor-18:job= -58/job-59 ctx-4a14e747) Seq 1-7036029992836286502: Sending { Cmd , MgmtId= : 55355881446856, via: 1(cldstk-R720-66), Ver: v1, Flags: 100011, [{"com.cl= oud.agent.api.StartCommand":{"vm":{"id":9,"name":"i-3-9-VM","bootloader":"P= yGrub","type":"User","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":214748= 3648,"maxRam":2147483648,"arch":"x86_64","os":"CentOS 5.6 (64-bit)","bootAr= gs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDy= namicallyScaleVm":false,"vncPassword":"1439f05b06e154d2","params":{},"uuid"= :"00069b3f-abf0-4f0d-a12c-6ae9d1a3ea81","disks":[{"data":{"org.apache.cloud= stack.storage.to.VolumeObjectTO":{"uuid":"e92dcd30-3775-4762-bb83-b6c9d9016= 44b","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.Pri= maryDataStoreTO":{"uuid":"e8ccf63a-577b-3378-9741-16ce76631992","id":1,"poo= lType":"NetworkFilesystem","host":"10.102.192.101","path":"/Sailaja/goletag= pups1","port":2049,"url":"NetworkFilesystem://10.102.192.101/Sailaja/goleta= gpups1/?ROLE=3DPrimary&STOREUUID=3De8ccf63a-577b-3378-9741-16ce76631992"}},= "name":"ROOT-9","size":21474836480,"path":"8d273d72-877c-4776-b4b5-9e52072e= a45f","volumeId":11,"vmName":"i-3-9-VM","accountId":3,"format":"VHD","id":1= 1,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"8d273d72-= 877c-4776-b4b5-9e52072ea45f","type":"ROOT","_details":{"managed":"false","s= toragePort":"2049","storageHost":"10.102.192.101","volumeSize":"21474836480= "}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"id":0,"f= ormat":"ISO","accountId":0,"hvm":false}},"diskSeq":3,"type":"ISO"}],"nics":= [{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"91973ed0-97f= 6-47bf-94ea-25751da81ae9","ip":"10.1.1.220","netmask":"255.255.255.0","gate= way":"10.1.1.1","mac":"02:00:03:4b:00:07","dns1":"10.140.50.5","broadcastTy= pe":"Vlan","type":"Guest","broadcastUri":"vlan://770","isolationUri":"vlan:= //770","isSecurityGroupEnabled":false}],"gpuDevice":{"gpuGroup":"Group of N= VIDIA Corporation GK104GL [GRID K2] GPUs","vgpuType":"GRID K200"}},"hostIp"= :"10.102.192.66","executeInSequence":false,"wait":0}}] } > 2014-05-05 16:38:50,732 DEBUG [c.c.a.t.Request] (Work-Job-Executor-18:job= -58/job-59 ctx-4a14e747) Seq 1-7036029992836286502: Executing: { Cmd , Mgm= tId: 55355881446856, via: 1(cldstk-R720-66), Ver: v1, Flags: 100011, [{"com= .cloud.agent.api.StartCommand":{"vm":{"id":9,"name":"i-3-9-VM","bootloader"= :"PyGrub","type":"User","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":214= 7483648,"maxRam":2147483648,"arch":"x86_64","os":"CentOS 5.6 (64-bit)","boo= tArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enabl= eDynamicallyScaleVm":false,"vncPassword":"1439f05b06e154d2","params":{},"uu= id":"00069b3f-abf0-4f0d-a12c-6ae9d1a3ea81","disks":[{"data":{"org.apache.cl= oudstack.storage.to.VolumeObjectTO":{"uuid":"e92dcd30-3775-4762-bb83-b6c9d9= 01644b","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.= PrimaryDataStoreTO":{"uuid":"e8ccf63a-577b-3378-9741-16ce76631992","id":1,"= poolType":"NetworkFilesystem","host":"10.102.192.101","path":"/Sailaja/gole= tagpups1","port":2049,"url":"NetworkFilesystem://10.102.192.101/Sailaja/gol= etagpups1/?ROLE=3DPrimary&STOREUUID=3De8ccf63a-577b-3378-9741-16ce76631992"= }},"name":"ROOT-9","size":21474836480,"path":"8d273d72-877c-4776-b4b5-9e520= 72ea45f","volumeId":11,"vmName":"i-3-9-VM","accountId":3,"format":"VHD","id= ":11,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"8d273d= 72-877c-4776-b4b5-9e52072ea45f","type":"ROOT","_details":{"managed":"false"= ,"storagePort":"2049","storageHost":"10.102.192.101","volumeSize":"21474836= 480"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"id":0= ,"format":"ISO","accountId":0,"hvm":false}},"diskSeq":3,"type":"ISO"}],"nic= s":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"91973ed0-= 97f6-47bf-94ea-25751da81ae9","ip":"10.1.1.220","netmask":"255.255.255.0","g= ateway":"10.1.1.1","mac":"02:00:03:4b:00:07","dns1":"10.140.50.5","broadcas= tType":"Vlan","type":"Guest","broadcastUri":"vlan://770","isolationUri":"vl= an://770","isSecurityGroupEnabled":false}],"gpuDevice":{"gpuGroup":"Group o= f NVIDIA Corporation GK104GL [GRID K2] GPUs","vgpuType":"GRID K200"}},"host= Ip":"10.102.192.66","executeInSequence":false,"wait":0}}] } > 2014-05-05 16:38:50,732 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-2= 96:ctx-251a7963) Seq 1-7036029992836286502: Executing request > 2014-05-05 16:38:50,743 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) 1. The VM i-3-9-VM is in Starting state. > 2014-05-05 16:38:50,780 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Created VM 2b2d13d8-42ea-301d-6b65-0ad093195826 for i-3-= 9-VM > 2014-05-05 16:38:50,794 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Creating VGPU for of VGPU type: GRID K200 in GPU group G= roup of NVIDIA Corporation GK104GL [GRID K2] GPUs for VM i-3-9-VM > 2014-05-05 16:38:50,794 DEBUG [c.c.h.x.r.XenServer620SP1Resource] (Direct= Agent-296:ctx-251a7963) Creating VGPU of VGPU type [ GRID K200 ] in gpu gro= upGroup of NVIDIA Corporation GK104GL [GRID K2] GPUs for VM i-3-9-VM > 2014-05-05 16:38:50,818 DEBUG [c.c.h.x.r.XenServer620SP1Resource] (Direct= Agent-296:ctx-251a7963) Created VGPU of VGPU type [ GRID K200 ] for VM i-3-= 9-VM > 2014-05-05 16:38:50,954 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) VBD 74e87e65-0066-f400-eb20-e322c0c64ebe created for com= .cloud.agent.api.to.DiskTO@61ba9994 > 2014-05-05 16:38:50,975 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) VBD d4e27c31-8ef4-49ca-661c-712f83568a03 created for com= .cloud.agent.api.to.DiskTO@21b8f5ac > 2014-05-05 16:38:50,975 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Creating VIF for i-3-9-VM on nic [Nic:Guest-10.1.1.220-v= lan://770] > 2014-05-05 16:38:51,000 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Found a network called VLAN-0a144be7-8521-934e-ff53-c62c= 59e75d69-770 on host=3D10.102.192.66; Network=3Dfa62257b-e53e-1e82-69f0-96= 3e63f853e0; pif=3D4fb4b5fd-c11c-5827-8198-8861506bda56 > 2014-05-05 16:38:51,011 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Created a vif c6b0df48-0a58-9640-5d23-302cf3c3d7b4 on 0 > 2014-05-05 16:38:52,033 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Task failed! Task record: uuid: fe8bd262= -4b47-9a13-ac8e-1c2cafbea4fb > nameLabel: Async.VM.start_on > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Mon May 05 15:28:17 IST 2014 > status: failure > residentOn: com.xensource.xenapi.Host@be7936ed > progress: 1.0 > type: > result: > errorInfo: [FEATURE_REQUIRES_HVM, vGPU- and GPU-passthrough ne= eds HVM] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > 2014-05-05 16:38:52,041 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Unable to start VM(i-3-9-VM) on host(76520b97-5ce8-4c71-= 9572-b0834b62dc35) due to Task failed! Task record: uuid: f= e8bd262-4b47-9a13-ac8e-1c2cafbea4fb > nameLabel: Async.VM.start_on > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Mon May 05 15:28:17 IST 2014 > finished: Mon May 05 15:28:17 IST 2014 > status: failure > residentOn: com.xensource.xenapi.Host@be7936ed > progress: 1.0 > type: > result: > errorInfo: [FEATURE_REQUIRES_HVM, vGPU- and GPU-passthrough ne= eds HVM] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > Task failed! Task record: uuid: fe8bd262-4b47-9a13-ac8e-1= c2cafbea4fb > nameLabel: Async.VM.start_on > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Mon May 05 15:28:17 IST 2014 > finished: Mon May 05 15:28:17 IST 2014 > status: failure > residentOn: com.xensource.xenapi.Host@be7936ed > progress: 1.0 > type: > result: > errorInfo: [FEATURE_REQUIRES_HVM, vGPU- and GPU-passthrough ne= eds HVM] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.checkForSuccess(= CitrixResourceBase.java:3346) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(C= itrixResourceBase.java:3458) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(C= itrixResourceBase.java:1812) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRe= quest(CitrixResourceBase.java:500) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeR= equest(XenServer56Resource.java:60) > at com.cloud.hypervisor.xen.resource.XenServer610Resource.execute= Request(XenServer610Resource.java:93) > at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.exec= uteRequest(XenServer620SP1Resource.java:64) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(D= irectAgentAttache.java:216) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:178) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:292) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2014-05-05 16:38:52,046 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) unable to destroy task(com.xensource.xenapi.Task@d080c3e= 6) on host(76520b97-5ce8-4c71-9572-b0834b62dc35) due to You gave an invalid= object reference. The object may have recently been deleted. The class p= arameter gives the type of reference given, and the handle parameter echoes= the bad value given. > 2014-05-05 16:38:52,046 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Catch Exception: class com.cloud.utils.exception.CloudRu= ntimeException due to com.cloud.utils.exception.CloudRuntimeException: Unab= le to start VM(i-3-9-VM) on host(76520b97-5ce8-4c71-9572-b0834b62dc35) due = to Task failed! Task record: uuid: fe8bd262-4b47-9a13-ac8e-= 1c2cafbea4fb > nameLabel: Async.VM.start_on > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Mon May 05 15:28:17 IST 2014 > finished: Mon May 05 15:28:17 IST 2014 > status: failure > residentOn: com.xensource.xenapi.Host@be7936ed > progress: 1.0 > type: > result: > errorInfo: [FEATURE_REQUIRES_HVM, vGPU- and GPU-passthrough ne= eds HVM] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(i-3-9= -VM) on host(76520b97-5ce8-4c71-9572-b0834b62dc35) due to Task failed! Task= record: uuid: fe8bd262-4b47-9a13-ac8e-1c2cafbea4fb > nameLabel: Async.VM.start_on > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Mon May 05 15:28:17 IST 2014 > finished: Mon May 05 15:28:17 IST 2014 > status: failure > residentOn: com.xensource.xenapi.Host@be7936ed > progress: 1.0 > type: > result: > errorInfo: [FEATURE_REQUIRES_HVM, vGPU- and GPU-passthrough ne= eds HVM] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(C= itrixResourceBase.java:3477) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(C= itrixResourceBase.java:1812) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRe= quest(CitrixResourceBase.java:500) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeR= equest(XenServer56Resource.java:60) > at com.cloud.hypervisor.xen.resource.XenServer610Resource.execute= Request(XenServer610Resource.java:93) > at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.exec= uteRequest(XenServer620SP1Resource.java:64) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(D= irectAgentAttache.java:216) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:178) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:292) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2014-05-05 16:38:52,048 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Unable to start i-3-9-VM due to > com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(i-3-9= -VM) on host(76520b97-5ce8-4c71-9572-b0834b62dc35) due to Task failed! Task= record: uuid: fe8bd262-4b47-9a13-ac8e-1c2cafbea4fb > nameLabel: Async.VM.start_on > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Mon May 05 15:28:17 IST 2014 > finished: Mon May 05 15:28:17 IST 2014 > status: failure > residentOn: com.xensource.xenapi.Host@be7936ed > progress: 1.0 > type: > result: > errorInfo: [FEATURE_REQUIRES_HVM, vGPU- and GPU-passthrough needs HVM] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(C= itrixResourceBase.java:3477) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(C= itrixResourceBase.java:1812) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRe= quest(CitrixResourceBase.java:500) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeR= equest(XenServer56Resource.java:60) > at com.cloud.hypervisor.xen.resource.XenServer610Resource.execute= Request(XenServer610Resource.java:93) > at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.exec= uteRequest(XenServer620SP1Resource.java:64) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(D= irectAgentAttache.java:216) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:178) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:292) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2014-05-05 16:38:52,060 DEBUG [c.c.a.ApiServlet] (catalina-exec-13:ctx-1d= 7ac3bf) =3D=3D=3DSTART=3D=3D=3D 10.144.6.6 -- GET command=3DqueryAsyncJob= Result&jobId=3D48d1d975-c105-4823-99e1-6fc5f51f180e&response=3Djson&session= key=3DTDXLIOmV8uKaEsb9Mr5o96exjw0%3D&_=3D1399288191562 > 2014-05-05 16:38:52,083 DEBUG [c.c.a.ApiServlet] (catalina-exec-13:ctx-1d= 7ac3bf ctx-6f979a7b) =3D=3D=3DEND=3D=3D=3D 10.144.6.6 -- GET command=3Dqu= eryAsyncJobResult&jobId=3D48d1d975-c105-4823-99e1-6fc5f51f180e&response=3Dj= son&sessionkey=3DTDXLIOmV8uKaEsb9Mr5o96exjw0%3D&_=3D1399288191562 > 2014-05-05 16:38:52,105 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Unable to clean up VBD due to > You gave an invalid object reference. The object may have recently been = deleted. The class parameter gives the type of reference given, and the ha= ndle parameter echoes the bad value given. > at com.xensource.xenapi.Types.checkResponse(Types.java:693) > at com.xensource.xenapi.Connection.dispatch(Connection.java:350) > at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenS= erverConnection.dispatch(XenServerConnectionPool.java:456) > at com.xensource.xenapi.VBD.unplug(VBD.java:1059) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmS= tartFailure(CitrixResourceBase.java:1542) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(C= itrixResourceBase.java:1892) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRe= quest(CitrixResourceBase.java:500) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeR= equest(XenServer56Resource.java:60) > at com.cloud.hypervisor.xen.resource.XenServer610Resource.execute= Request(XenServer610Resource.java:93) > at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.exec= uteRequest(XenServer620SP1Resource.java:64) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(D= irectAgentAttache.java:216) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.cal= l(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:178) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:292) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2014-05-05 16:38:52,112 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Unable to clean up VBD due to > You gave an invalid object reference. The object may have recently been = deleted. The class parameter gives the type of reference given, and the ha= ndle parameter echoes the bad value given. > at com.xensource.xenapi.Types.checkResponse(Types.java:693) > at com.xensource.xenapi.Connection.dispatch(Connection.java:350) > at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenS= erverConnection.dispatch(XenServerConnectionPool.java:456) > at com.xensource.xenapi.VBD.unplug(VBD.java:1059) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmS= tartFailure(CitrixResourceBase.java:1542) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(C= itrixResourceBase.java:1892) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRe= quest(CitrixResourceBase.java:500) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeR= equest(XenServer56Resource.java:60) > at com.cloud.hypervisor.xen.resource.XenServer610Resource.execute= Request(XenServer610Resource.java:93) > at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.exec= uteRequest(XenServer620SP1Resource.java:64) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(D= irectAgentAttache.java:216) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:178) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:292) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2014-05-05 16:38:52,119 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) Unable to cleanup VIF > You gave an invalid object reference. The object may have recently been = deleted. The class parameter gives the type of reference given, and the ha= ndle parameter echoes the bad value given. > at com.xensource.xenapi.Types.checkResponse(Types.java:693) > at com.xensource.xenapi.Connection.dispatch(Connection.java:350) > at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenS= erverConnection.dispatch(XenServerConnectionPool.java:456) > at com.xensource.xenapi.VIF.unplug(VIF.java:878) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmS= tartFailure(CitrixResourceBase.java:1550) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixRes= ourceBase.java:1892) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRe= quest(CitrixResourceBase.java:500) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeR= equest(XenServer56Resource.java:60) > at com.cloud.hypervisor.xen.resource.XenServer610Resource.execute= Request(XenServer610Resource.java:93) > at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.exec= uteRequest(XenServer620SP1Resource.java:64) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(D= irectAgentAttache.java:216) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.access$201(ScheduledThreadPoolExecutor.java:178) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutu= reTask.run(ScheduledThreadPoolExecutor.java:292) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2014-05-05 16:38:52,137 INFO [c.c.h.x.r.XenServer56Resource] (DirectAgen= t-296:ctx-251a7963) Catch com.xensource.xenapi.Types$VifInUse: failed to de= story VLAN eth0 on host 76520b97-5ce8-4c71-9572-b0834b62dc35 due to Network= has active VIFs > 2014-05-05 16:38:52,137 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent= -296:ctx-251a7963) The VM is in stopped state, detected problem during star= tup : i-3-9-VM > 2014-05-05 16:38:52,137 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-2= 96:ctx-251a7963) Seq 1-7036029992836286502: Response Received: > 2014-05-05 16:38:52,139 DEBUG [c.c.a.t.Request] (DirectAgent-296:ctx-251a= 7963) Seq 1-7036029992836286502: Processing: { Ans: , MgmtId: 553558814468= 56, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StartAnswer":{"vm":{= "id":9,"name":"i-3-9-VM","bootloader":"PyGrub","type":"User","cpus":1,"minS= peed":500,"maxSpeed":500,"minRam":2147483648,"maxRam":2147483648,"arch":"x8= 6_64","os":"CentOS 5.6 (64-bit)","bootArgs":"","rebootOnCrash":false,"enabl= eHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPasswor= d":"1439f05b06e154d2","params":{},"uuid":"00069b3f-abf0-4f0d-a12c-6ae9d1a3e= a81","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"= uuid":"e92dcd30-3775-4762-bb83-b6c9d901644b","volumeType":"ROOT","dataStore= ":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"e8ccf63a-= 577b-3378-9741-16ce76631992","id":1,"poolType":"NetworkFilesystem","host":"= 10.102.192.101","path":"/Sailaja/goletagpups1","port":2049,"url":"NetworkFi= lesystem://10.102.192.101/Sailaja/goletagpups1/?ROLE=3DPrimary&STOREUUID=3D= e8ccf63a-577b-3378-9741-16ce76631992"}},"name":"ROOT-9","size":21474836480,= "path":"8d273d72-877c-4776-b4b5-9e52072ea45f","volumeId":11,"vmName":"i-3-9= -VM","accountId":3,"format":"VHD","id":11,"deviceId":0,"hypervisorType":"Xe= nServer"}},"diskSeq":0,"path":"8d273d72-877c-4776-b4b5-9e52072ea45f","type"= :"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"1= 0.102.192.101","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack= .storage.to.TemplateObjectTO":{"id":0,"format":"ISO","accountId":0,"hvm":fa= lse}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":20= 0,"defaultNic":true,"uuid":"91973ed0-97f6-47bf-94ea-25751da81ae9","ip":"10.= 1.1.220","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:03:4b:= 00:07","dns1":"10.140.50.5","broadcastType":"Vlan","type":"Guest","broadcas= tUri":"vlan://770","isolationUri":"vlan://770","isSecurityGroupEnabled":fal= se}],"gpuDevice":{"gpuGroup":"Group of NVIDIA Corporation GK104GL [GRID K2]= GPUs","vgpuType":"GRID K200","groupDetails":{"Group of NVIDIA Corporation = GK104GL [GRID K2] GPUs":{"GRID K200":{"modelName":"GRID K200","maxHeads":2,= "videoRam":268435456,"maxResolutionX":1920,"maxResolutionY":1200,"maxVgpuPe= rGpu":8,"remainingCapacity":16,"maxCapacity":16},"passthrough":{"modelName"= :"passthrough","maxHeads":0,"videoRam":0,"maxResolutionX":0,"maxResolutionY= ":0,"maxVgpuPerGpu":1,"remainingCapacity":2,"maxCapacity":2},"GRID K260Q":{= "modelName":"GRID K260Q","maxHeads":4,"videoRam":2013265920,"maxResolutionX= ":2560,"maxResolutionY":1600,"maxVgpuPerGpu":2,"remainingCapacity":4,"maxCa= pacity":4},"GRID K240Q":{"modelName":"GRID K240Q","maxHeads":2,"videoRam":1= 006632960,"maxResolutionX":2560,"maxResolutionY":1600,"maxVgpuPerGpu":4,"re= mainingCapacity":8,"maxCapacity":8}}}}},"_iqnToPath":{},"result":false,"det= ails":"Unable to start i-3-9-VM due to ","wait":0}}] } > 2014-05-05 16:38:52,139 DEBUG [c.c.a.t.Request] (Work-Job-Executor-18:job= -58/job-59 ctx-4a14e747) Seq 1-7036029992836286502: Received: { Ans: , Mgm= tId: 55355881446856, via: 1, Ver: v1, Flags: 10, { StartAnswer } } > 2014-05-05 16:38:52,142 INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job= -Executor-18:job-58/job-59 ctx-4a14e747) Unable to start VM on Host[-1-Rout= ing] due to Unable to start i-3-9-VM due to > 2014-05-05 16:38:52,145 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job= -Executor-18:job-58/job-59 ctx-4a14e747) Cleaning up resources for the vm V= M[User|i-3-9-VM] in Starting state > 2014-05-05 16:38:52,148 DEBUG [c.c.a.t.Request] (Work-Job-Executor-18:job= -58/job-59 ctx-4a14e747) Seq 1-7036029992836286503: Sending { Cmd , MgmtId= : 55355881446856, via: 1(cldstk-R720-66), Ver: v1, Flags: 100011, [{"com.cl= oud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"chec= kBeforeCleanup":false,"vmName":"i-3-9-VM","wait":0}}] } > 2014-05-05 16:38:52,148 DEBUG [c.c.a.t.Request] (Work-Job-Executor-18:job= -58/job-59 ctx-4a14e747) Seq 1-7036029992836286503: Executing: { Cmd , Mgm= tId: 55355881446856, via: 1(cldstk-R720-66), Ver: v1, Flags: 100011, [{"com= .cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"c= heckBeforeCleanup":false,"vmName":"i-3-9-VM","wait":0}}] } > 2014-05-05 16:38:52,224 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Exe= cutor-18:job-58/job-59 ctx-4a14e747) Invocation exception, caused by: com.c= loud.exception.InsufficientServerCapacityException: Unable to create a depl= oyment for VM[User|i-3-9-VM]Scope=3Dinterface com.cloud.dc.DataCenter; id= =3D1 > 2014-05-05 16:38:52,225 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Exe= cutor-18:job-58/job-59 ctx-4a14e747) Rethrow exception com.cloud.exception.= InsufficientServerCapacityException: Unable to create a deployment for VM[U= ser|i-3-9-VM]Scope=3Dinterface com.cloud.dc.DataCenter; id=3D1 > 2014-05-05 16:38:52,226 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Execu= tor-18:job-58/job-59) Done with run of VM work job: com.cloud.vm.VmWorkStar= t for VM 9, job origin: 58 > 2014-05-05 16:38:52,226 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Execu= tor-18:job-58/job-59) Unable to complete AsyncJobVO {id:59, userId: 3, acco= untId: 3, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkSta= rt, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABG= RjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsd= WRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtq= b3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJ= MAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA= 9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV= 29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1l= cQB-AAN4cAAAAAAAAAADAAAAAAAAAAMAAAAAAAAACXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckl= tcGwAAAAAAAAAAXBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdm= EubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAAFxAH4ACnBwcHEAfgAKcHNyABFqYXZhL= nV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAA= AAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt= 4cA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, r= esult: null, initMsid: 55355881446856, completeMsid: null, lastUpdated: nul= l, lastPolled: null, created: Mon May 05 16:38:46 IST 2014}, job origin:58 > com.cloud.exception.InsufficientServerCapacityException: Unable to create= a deployment for VM[User|i-3-9-VM]Scope=3Dinterface com.cloud.dc.DataCente= r; id=3D1 > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(Virtua= lMachineManagerImpl.java:943) > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(Virtua= lMachineManagerImpl.java:5167) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess= orImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHa= ndlerProxy.java:107) > at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(Virtual= MachineManagerImpl.java:5312) > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.ja= va:102) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$= 5.runInContext(AsyncJobManagerImpl.java:495) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$= 5.run(AsyncJobManagerImpl.java:452) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2014-05-05 16:38:52,228 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-18:job-58/job-59) Complete async job-59, jobStatus: FAILED, resul= tCode: 0, result: rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlA= gAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dh= Ymxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1= lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3= RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc= 3Q7eHBxAH4AB3QAT0pvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRl= IGEgZGVwbG95bWVudCBmb3IgVk1bVXNlcnxpLTMtOS1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2t= UcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAAA1zcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbG= VtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABEwACGZpb= GVOYW1lcQB-AARMAAptZXRob2ROYW1lcQB-AAR4cAAAAHJ0ACBjb20uY2xvdWQudm0uVm1Xb3Jr= Sm9iRGlzcGF0Y2hlcnQAGFZtV29ya0pvYkRpc3BhdGNoZXIuamF2YXQABnJ1bkpvYnNxAH4ACwA= AAe90AD9vcmcuYXBhY2hlLmNsb3Vkc3RhY2suZnJhbWV3b3JrLmpvYnMuaW1wbC5Bc3luY0pvYk= 1hbmFnZXJJbXBsJDV0ABhBc3luY0pvYk1hbmFnZXJJbXBsLmphdmF0AAxydW5JbkNvbnRleHRzc= QB-AAsAAAAxdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2Vk= Q29udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5zcQB= -AAsAAAA4dABCb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZm= F1bHRNYW5hZ2VkQ29udGV4dCQxdAAaRGVmYXVsdE1hbmFnZWRDb250ZXh0LmphdmF0AARjYWxsc= 3EAfgALAAAAZ3QAQG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5E= ZWZhdWx0TWFuYWdlZENvbnRleHRxAH4AGnQAD2NhbGxXaXRoQ29udGV4dHNxAH4ACwAAADVxAH4= AHXEAfgAadAAOcnVuV2l0aENvbnRleHRzcQB-AAsAAAAudAA8b3JnLmFwYWNoZS5jbG91ZHN0YW= NrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlcQB-ABZxAH4AF3NxAH4AC= wAAAcRxAH4AEXEAfgAScQB-ABdzcQB-AAsAAAHXdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuRXhl= Y3V0b3JzJFJ1bm5hYmxlQWRhcHRlcnQADkV4ZWN1dG9ycy5qYXZhcQB-ABtzcQB-AAsAAAEGdAA= famF2YS51dGlsLmNvbmN1cnJlbnQuRnV0dXJlVGFza3QAD0Z1dHVyZVRhc2suamF2YXEAfgAXc3= EAfgALAAAEeXQAJ2phdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvcnQAF1Roc= mVhZFBvb2xFeGVjdXRvci5qYXZhdAAJcnVuV29ya2Vyc3EAfgALAAACZ3QALmphdmEudXRpbC5j= b25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvciRXb3JrZXJxAH4ALHEAfgAXc3EAfgALAAAC6HQ= AEGphdmEubGFuZy5UaHJlYWR0AAtUaHJlYWQuamF2YXEAfgAXc3IAJmphdmEudXRpbC5Db2xsZW= N0aW9ucyRVbm1vZGlmaWFibGVMaXN0_A8lMbXsjhACAAFMAARsaXN0cQB-AAZ4cgAsamF2YS51d= GlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUNvbGxlY3Rpb24ZQgCAy173HgIAAUwAAWN0ABZM= amF2YS91dGlsL0NvbGxlY3Rpb247eHBzcgATamF2YS51dGlsLkFycmF5TGlzdHiB0h2Zx2GdAwA= BSQAEc2l6ZXhwAAAAAHcEAAAAAHhxAH4AOHg > CCP should=20 -- This message was sent by Atlassian JIRA (v6.3.4#6332)