Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3839B10CC1 for ; Fri, 5 Jul 2013 10:21:53 +0000 (UTC) Received: (qmail 19214 invoked by uid 500); 5 Jul 2013 10:21:52 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 19191 invoked by uid 500); 5 Jul 2013 10:21:51 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 19181 invoked by uid 500); 5 Jul 2013 10:21:49 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 19178 invoked by uid 99); 5 Jul 2013 10:21:48 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Jul 2013 10:21:48 +0000 Date: Fri, 5 Jul 2013 10:21:48 +0000 (UTC) From: "Sanjeev N (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (CLOUDSTACK-3379) [Object_Store_Refactor] Spinning system vms failed with CloudRuntimeException: No cache DataStore in scope id 1 type ZONE MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Sanjeev N created CLOUDSTACK-3379: ------------------------------------- Summary: [Object_Store_Refactor] Spinning system vms failed with CloudRuntimeException: No cache DataStore in scope id 1 type ZONE Key: CLOUDSTACK-3379 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3379 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.2.0 Environment: Latest build from master branch Reporter: Sanjeev N Priority: Blocker Fix For: 4.2.0 [Object_Store_Refactor] Spinning system vms failed with CloudRuntimeException: No cache DataStore in scope id 1 type ZONE System vms failed to come up when there are two zones in the system and only one Cache storage. Steps to Reproduce: ================ 1.Bring up CS with latest master build 2.Add two zones say zone1 with xen and zone2 with vmware clusters 3.Add S3 storage and Cache Storage from zone2. Does not specify any cache storage in zone1 4.Enable both the zones Observations: =========== 1.After step3 vmware system template was successfully download to S3 storage. 2,After step4 CS tried to bring up system vms using the esx routing template but failed because there is no cache storage in zone1. mysql> select * from image_store\G; *************************** 1. row *************************** id: 6 name: objectstore image_provider_name: S3 protocol: http url: NULL data_center_id: NULL scope: REGION role: Image uuid: a62707cd-8cfc-490d-81c6-dfc8d706648f parent: NULL created: 2013-07-05 15:15:54 removed: NULL total_size: NULL used_bytes: NULL *************************** 2. row *************************** id: 7 name: nfs://10.147.28.7/export/home/sanjeev/sec_esx_os image_provider_name: NFS protocol: nfs url: nfs://10.147.28.7/export/home/sanjeev/sec_esx_os data_center_id: 2 scope: ZONE role: ImageCache uuid: 30d3d201-d285-4ce5-a909-598c0abb8cf3 parent: NULL created: 2013-07-05 15:15:54 removed: NULL total_size: NULL used_bytes: NULL 2 rows in set (0.01 sec) ERROR: No query specified mysql> select * from data_center; +----+--------------+--------------------------------------+-------------+---------------+------+---------------+---------------+---------+---------+--------------------+-------------+--------------------+--------+-----------+-------------+---------------+------------------+-------------------+---------------+---------------+---------------+-------------------+------------------+--------------------------------------+---------------------------+--------------------------+---------+-------+---------+-------------+--------------+----------+----------+ | id | name | uuid | description | dns1 | dns2 | internal_dns1 | internal_dns2 | gateway | netmask | router_mac_address | mac_address | guest_network_cidr | domain | domain_id | networktype | dns_provider | gateway_provider | firewall_provider | dhcp_provider | lb_provider | vpn_provider | userdata_provider | allocation_state | zone_token | is_security_group_enabled | is_local_storage_enabled | removed | owner | created | lastUpdated | engine_state | ip6_dns1 | ip6_dns2 | +----+--------------+--------------------------------------+-------------+---------------+------+---------------+---------------+---------+---------+--------------------+-------------+--------------------+--------+-----------+-------------+---------------+------------------+-------------------+---------------+---------------+---------------+-------------------+------------------+--------------------------------------+---------------------------+--------------------------+---------+-------+---------+-------------+--------------+----------+----------+ | 1 | zone1 | 2b76f2bc-a859-4253-a7de-cc7d105eb82a | NULL | 10.103.128.16 | NULL | 10.103.128.16 | NULL | NULL | NULL | 02:00:00:00:00:01 | 21 | 10.1.1.0/24 | NULL | NULL | Advanced | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | Enabled | 894a4b6d-9721-3bdd-821c-f4bb50c9bb70 | 0 | 0 | NULL | NULL | NULL | NULL | Disabled | NULL | NULL | | 2 | zone2-vmware | 1c0f8682-73fa-42b1-a49a-a160fb688b60 | NULL | 10.103.128.16 | NULL | 10.103.128.16 | NULL | NULL | NULL | 02:00:00:00:00:01 | 19 | 10.1.1.0/24 | NULL | NULL | Advanced | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | VirtualRouter | Enabled | 21e6f09b-2b7e-3ad4-8546-0c40394d9b39 | 0 | 0 | NULL | NULL | NULL | NULL | Disabled | NULL | NULL | +----+--------------+--------------------------------------+-------------+---------------+------+---------------+---------------+---------+---------+--------------------+-------------+--------------------+--------+-----------+-------------+---------------+------------------+-------------------+---------------+---------------+---------------+-------------------+------------------+--------------------------------------+---------------------------+--------------------------+---------+-------+---------+-------------+--------------+----------+----------+ 2 rows in set (0.04 sec) 2013-07-05 11:28:21,720 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-1214-VM] 2013-07-05 11:28:22,001 DEBUG [storage.motion.AncientDataMotionStrategy] (secstorage-1:null) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE 2013-07-05 11:28:22,015 DEBUG [storage.motion.AncientDataMotionStrategy] (secstorage-1:null) needCacheStorage true, dest at null dest role Primarytemplate/tmpl/1/1/routing-1/systemvmtemplate-2013-06-23-master-xen.vhd.bz2 src role Image 2013-07-05 11:28:22,021 DEBUG [cache.allocator.StorageCacheRandomAllocator] (secstorage-1:null) Can't find cache storage in zone: 1 2013-07-05 11:28:22,022 DEBUG [storage.motion.AncientDataMotionStrategy] (secstorage-1:null) copy object failed: com.cloud.utils.exception.CloudRuntimeException: No cache DataStore in scope id 1 type ZONE 2013-07-05 11:28:22,025 DEBUG [storage.motion.AncientDataMotionStrategy] (secstorage-1:null) copy failed com.cloud.utils.exception.CloudRuntimeException: com.cloud.utils.exception.CloudRuntimeException: No cache DataStore in scope id 1 type ZONE at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyObject(AncientDataMotionStrategy.java:204) at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:351) at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:55) at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:390) at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:490) at com.cloud.storage.VolumeManagerImpl.recreateVolume(VolumeManagerImpl.java:2485) at com.cloud.storage.VolumeManagerImpl.prepare(VolumeManagerImpl.java:2542) at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:852) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:557) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:550) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:260) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:683) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1290) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:104) at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-07-05 11:28:22,076 DEBUG [cloud.storage.VolumeManagerImpl] (secstorage-1:null) Unable to create Vol[1214|vm=1214|ROOT]:com.cloud.utils.exception.CloudRuntimeException: com.cloud.utils.exception.CloudRuntimeException: No cache DataStore in scope id 1 type ZONE 2013-07-05 11:28:22,076 INFO [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Unable to contact resource. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1214|vm=1214|ROOT]:com.cloud.utils.exception.CloudRuntimeException: com.cloud.utils.exception.CloudRuntimeException: No cache DataStore in scope id 1 type ZONE at com.cloud.storage.VolumeManagerImpl.recreateVolume(VolumeManagerImpl.java:2493) at com.cloud.storage.VolumeManagerImpl.prepare(VolumeManagerImpl.java:2542) at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:852) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:557) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:550) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:260) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:683) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1290) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:104) at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira