cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nishan Sanjeewa Gunasekara <nishan.sanje...@gmail.com>
Subject Re: Failing to add Primary storage
Date Mon, 03 Mar 2014 01:47:54 GMT
Hi Geoff,
You are right, it was a problem with my storage server. Got it fixed. All
good. Thank you very much.

//
Nishan


On Mon, Mar 3, 2014 at 9:48 AM, Geoff Higginbottom <
geoff.higginbottom@shapeblue.com> wrote:

> What is providing hosting primary storage and was nfs set up in line with
> install docs e.g.
>
> To configure the new directories as NFS exports, edit /etc/exports. Export
> the NFS share(s) with rw,async,no_root_squash. For example:
>
> # vi /etc/exports
> Insert the following line.
> /export *(rw,async,no_root_squash)
>
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
> +442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.com>
> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<
> https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://5>
>
>
> On 2 Mar 2014, at 20:58, "Nishan Sanjeewa Gunasekara" <
> nishan.sanjeewa@gmail.com<mailto:nishan.sanjeewa@gmail.com>> wrote:
>
> Yes. Host is shown as online. Strange thing is cloudstack tries to create
> an SR for primary storage and times out on that. I can see that sr from
> xencenter. But it's broken and cannot be deleted as well. Only way to reuse
> this host is to reinstall xen. Any thoughts?
> Regards
> On Mar 2, 2014 6:09 PM, "Geoff Higginbottom" <
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.com>>
> wrote:
>
> I assume your host is showing as online in the UI
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
> +442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.com
> ><mailto:geoff.higginbottom@shapeblue.com>
> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://37>
>
>
>
> On 1 Mar 2014, at 23:30, "Nishan Sanjeewa Gunasekara" <
> nishan.sanjeewa@gmail.com<mailto:nishan.sanjeewa@gmail.com><mailto:
> nishan.sanjeewa@gmail.com>> wrote:
>
> Hi,
>
> Yes, I can mount the primary storage manually and write to it.
>
> For the network im using a bonded nic and i have the traffic label to match
> to what I defined in the cloudstack networks.
> And Im using a native vlan for all the traffic, so I didn't use a separate
> storage network when I defined the cloudstack networks.
>
> regards,
> Nishan
>
>
>
> On Sun, Mar 2, 2014 at 9:48 AM, Geoff Higginbottom <
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.com
> ><mailto:geoff.higginbottom@shapeblue.com>>
> wrote:
>
> Have you tried manually mounting the storage directly in the host?
>
> Also check that the host has a suitable NIC/Bond on the appropriate VLAN
> for your prim awry storage network (not to be confused with the CloudStack
> Storage Network which is for Secondary Storage)
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
> +442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.com
> ><mailto:geoff.higginbottom@shapeblue.com
> <mailto:geoff.higginbottom@shapeblue.com>
> | www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com
> ><htp://www.shapeblue.com/> |
> Twitter:@cloudstackguru<
> https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://5>
>
>
> On 1 Mar 2014, at 21:53, "Nishan Sanjeewa Gunasekara" <
> nishan.sanjeewa@gmail.com<mailto:nishan.sanjeewa@gmail.com><mailto:
> nishan.sanjeewa@gmail.com><mailto:
> nishan.sanjeewa@gmail.com<mailto:nishan.sanjeewa@gmail.com>>> wrote:
>
> Hi Cloudstack team,
> Need some help on this.
> I'm using CS 4.2.1 with XenServer 6.2
>
> While trying to create an advanced zone it fails at primary storage
> creation.
>
> These are the log snippets,
>
> 2014-03-02 08:32:24,551 DEBUG
> [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl]
> (catalina-exec-22:null) creating pool null on  host 1
> 2014-03-02 08:32:24,556 DEBUG [agent.transport.Request]
> (catalina-exec-22:null) Seq 1-1614282760: Sending  { Cmd , MgmtId:
> 174373135997068, via: 1, Ver: v1, Flags: 100011,
>
>
>
> [{"com.cloud.agent.api.CreateStoragePoolCommand":{"add":true,"pool":{"id":1,"uuid":"c1e2ff6c-925b-34b5-985d-d80969a70c05","host":"10.32.11.40","path":"/POOL1TB_CS2_ONE/CS2_PRI_STOR_01","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//c1e2ff6c-925b-34b5-985d-d80969a70c05","wait":0}}]
> }
> 2014-03-02 08:32:24,556 DEBUG [agent.transport.Request]
> (catalina-exec-22:null) Seq 1-1614282760: Executing:  { Cmd , MgmtId:
> 174373135997068, via: 1, Ver: v1, Flags: 100011,
>
>
>
> [{"com.cloud.agent.api.CreateStoragePoolCommand":{"add":true,"pool":{"id":1,"uuid":"c1e2ff6c-925b-34b5-985d-d80969a70c05","host":"10.32.11.40","path":"/POOL1TB_CS2_ONE/CS2_PRI_STOR_01","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//c1e2ff6c-925b-34b5-985d-d80969a70c05","wait":0}}]
> }
> 2014-03-02 08:32:24,556 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-3:null) Seq 1-1614282760: Executing request
> 2014-03-02 08:32:34,960 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl]
> (consoleproxy-1:null) Skip capacity scan due to there is no Primary Storage
> UPintenance mode
> 2014-03-02 08:32:35,915 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:null) Found 0 routers to update status.
> 2014-03-02 08:32:35,916 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
> 2014-03-02 08:32:44,444 WARN  [xen.resource.CitrixResourceBase]
> (DirectAgent-3:null) Catch Exception
> com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed
> due to com.cloud.utils.exception.CloudRuntimeException: Unable to create
> NFS SR Pool[1|10.32.11.40:2049|/POOL1TB_CS2_ONE/CS2_PRI_STOR_01] on
> host:365d6026-7931-4ee2-a341-255336a15a69 pool:
> 10.32.11.40/POOL1TB_CS2_ONE/CS2_PRI_STOR_01
> com.cloud.utils.exception.CloudRuntimeException: Unable to create NFS SR
> Pool[1|10.32.11.40:2049|/POOL1TB_CS2_ONE/CS2_PRI_STOR_01]
>      at
>
>
>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNfsSR(CitrixResourceBase.java:6473)
>      at
>
>
>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5458)
>      at
>
>
>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:517)
>      at
>
>
>
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>      at
>
>
>
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>      at
>
>
>
> com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>      at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>      at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>      at
>
>
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>      at
>
>
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>      at
>
>
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>      at
>
>
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>      at java.lang.Thread.run(Thread.java:701)
> Caused by: SR_BACKEND_FAILURE_40The SR scan failed
> [opterr=uuid=1c802a9f-23e9-4189-ad58-b1d2052c579b]
>      at com.xensource.xenapi.Types.checkResponse(Types.java:1936)
>      at com.xensource.xenapi.Connection.dispatch(Connection.java:368)
>      at
>
>
>
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909)
>      at com.xensource.xenapi.SR.scan(SR.java:1241)
>      at
>
>
>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNfsSR(CitrixResourceBase.java:6470)
>      ... 13 more
> 2014-03-02 08:32:44,446 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-3:null) Seq 1-1614282760: Response Received:
> 2014-03-02 08:32:44,446 DEBUG [agent.transport.Request]
> (DirectAgent-3:null) Seq 1-1614282760: Processing:  { Ans: , MgmtId:
> 174373135997068, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":false,"details":"Catch Exception
> com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed
> due to com.cloud.utils.exception.CloudRuntimeException: Unable to create
> NFS SR Pool[1|10.32.11.40:2049|/POOL1TB_CS2_ONE/CS2_PRI_STOR_01] on
> host:365d6026-7931-4ee2-a341-255336a15a69 pool:
> 10.32.11.40/POOL1TB_CS2_ONE/CS2_PRI_STOR_01","wait":0}}] }
> 2014-03-02 08:32:44,446 DEBUG [agent.transport.Request]
> (catalina-exec-22:null) Seq 1-1614282760: Received:  { Ans: , MgmtId:
> 174373135997068, via: 1, Ver: v1, Flags: 10, { Answer } }
> 2014-03-02 08:32:44,446 DEBUG [agent.manager.AgentManagerImpl]
> (catalina-exec-22:null) Details from executing class
> com.cloud.agent.api.CreateStoragePoolCommand: Catch Exception
> com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed
> due to com.cloud.utils.exception.CloudRuntimeException: Unable to create
> NFS SR Pool[1|10.32.11.40:2049|/POOL1TB_CS2_ONE/CS2_PRI_STOR_01] on
> host:365d6026-7931-4ee2-a341-255336a15a69 pool:
> 10.32.11.40/POOL1TB_CS2_ONE/CS2_PRI_STOR_01
>
> What am I missing here?
>
> I can see the vhd-util is copied to the host.
>
> [root@cs2-chas01-bl08 ~]# ls -l /opt/cloud/bin/
> total 532
> -rwxr-xr-x 1 root root   1078 Mar  2 08:32 add_to_vcpus_params_live.sh
> -rwxr-xr-x 1 root root   1267 Mar  2 08:32 bumpUpPriority.sh
> -rwxr-xr-x 1 root root   2181 Mar  2 08:32 call_firewall.sh
> -rwxr-xr-x 1 root root   2259 Mar  2 08:32 call_loadbalancer.sh
> -rwxr-xr-x 1 root root   1728 Mar  2 08:32 check_heartbeat.sh
> -rwxr-xr-x 1 root root   1131 Mar  2 08:32 cloud-clean-vlan.sh
> -rwxr-xr-x 1 root root   3620 Mar  2 08:32 cloud-prepare-upgrade.sh
> -rwxr-xr-x 1 root root   4850 Mar  2 08:32 cloud-setup-bonding.sh
> -rwxr-xr-x 1 root root   4117 Mar  2 08:32
> copy_vhd_from_secondarystorage.sh
> -rwxr-xr-x 1 root root   3099 Mar  2 08:32 copy_vhd_to_secondarystorage.sh
> -rwxr-xr-x 1 root root   1043 Mar  2 08:32 createipAlias.sh
> -rwxr-xr-x 1 root root   3115 Mar  2 08:32
> create_privatetemplate_from_snapshot.sh
> -rwxr-xr-x 1 root root   1045 Mar  2 08:32 deleteipAlias.sh
> -rwxr-xr-x 1 root root   2055 Mar  2 08:32 dhcp_entry.sh
> -rw-r--r-- 1 root root      0 Mar  2 08:32 heartbeat
> -rwxr-xr-x 1 root root   1170 Mar  2 08:32 kill_copy_process.sh
> -rwxr-xr-x 1 root root   1301 Mar  2 08:32 launch_hb.sh
> -rwxr-xr-x 1 root root   2475 Mar  2 08:32 make_migratable.sh
> -rwxr-xr-x 1 root root   1412 Mar  2 08:32 network_info.sh
> -rwxr-xr-x 1 root root   1025 Mar  2 08:32 ovs-get-bridge.sh
> -rwxr-xr-x 1 root root    999 Mar  2 08:32 ovs-get-dhcp-iface.sh
> -rwxr-xr-x 1 root root    893 Mar  2 08:32 ovs-pvlan-cleanup.sh
> -rwxr-xr-x 1 root root   2987 Mar  2 08:32 ovs-pvlan-dhcp-host.sh
> -rwxr-xr-x 1 root root   2430 Mar  2 08:32 ovs-pvlan-vm.sh
> -rwxr-xr-x 1 root root   3443 Mar  2 08:32 pingtest.sh
> -rwxr-xr-x 1 root root   1231 Mar  2 08:32 router_proxy.sh
> -rwxr-xr-x 1 root root   1969 Mar  2 08:32 save_password_to_domr.sh
> -rwxr-xr-x 1 root root   2254 Mar  2 08:32 setup_heartbeat_file.sh
> -rwxr-xr-x 1 root root   2539 Mar  2 08:32 setup_heartbeat_sr.sh
> -rwxr-xr-x 1 root root   1769 Mar  2 08:32 setup_iscsi.sh
> -rwxr-xr-x 1 root root   2202 Mar  2 08:32 setupxenserver.sh
> -rwxr-xr-x 1 root root  75573 Mar  2 08:32 swift
> -rwxr-xr-x 1 root root   3043 Mar  2 08:32 upgrade_snapshot.sh
> -rwxr-xr-x 1 root root 318977 Mar  2 08:32 vhd-util
> -rwxr-xr-x 1 root root   2822 Mar  2 08:32 xenheartbeat.sh
>
>
> Appreciate your help;
> Thank you,
> Nishan
> Need Enterprise Grade Support for Apache CloudStack?
> Our CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/> offers the best
> 24/7 SLA for CloudStack Environments.
>
> Apache CloudStack Bootcamp training courses
>
> **NEW!** CloudStack 4.2.1 training<
> http://shapeblue.com/cloudstack-training/>
> 18th-19th February 2014, Brazil. Classroom<
> http://shapeblue.com/cloudstack-training/>
> 17th-23rd March 2014, Region A. Instructor led, On-line<
> http://shapeblue.com/cloudstack-training/>
> 24th-28th March 2014, Region B. Instructor led, On-line<
> http://shapeblue.com/cloudstack-training/>
> 16th-20th June 2014, Region A. Instructor led, On-line<
> http://shapeblue.com/cloudstack-training/>
> 23rd-27th June 2014, Region B. Instructor led, On-line<
> http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue is a
> registered trademark.
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue is a
> registered trademark.
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue is a
> registered trademark.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message