Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@cloudstack.apache.org
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII;
 format=flowed
Content-Transfer-Encoding: 7bit
Date: Fri, 11 Sep 2015 10:53:22 +0300
From: Vadim Kimlaychuk <vadim@kickcloud.net>
To: users@cloudstack.apache.org
Subject: RE: Unable to add Ceph KVM node in cloudstack
Organization: kickcloud.net
In-Reply-To: 
 <659EF5C7A0B2134793E1A6D463A568A04A8602F0@DCOENG1-EX-MB6.virtela.cc>
References: 
 <659EF5C7A0B2134793E1A6D463A568A04A859A61@DCOENG1-EX-MB5.virtela.cc>
 <0e49a4001f691900fb2f870701b1b1c6@ant.ee>
 <659EF5C7A0B2134793E1A6D463A568A04A859B0A@DCOENG1-EX-MB5.virtela.cc>
 <6770669c044d71d96b4ae7e607f05f3a@ant.ee>
 <659EF5C7A0B2134793E1A6D463A568A04A85A60E@DCOENG1-EX-MB5.virtela.cc>
 <f957bf5abe6878374c6da2a18ceea20d@ant.ee>
 <659EF5C7A0B2134793E1A6D463A568A04A8602F0@DCOENG1-EX-MB6.virtela.cc>
Message-ID: <0d888b6619e283ff6019c81d288d6b58@ant.ee>
User-Agent: Roundcube Webmail/1.1.1

For KVM hosts RBD comes "out of the box" with libvirt. For XenServer 
Ceph (RBD) storage type is not yet implemented. I would say it is very 
hypervisor-specific and does not depend much from Cloudstack.

Regards,

Vadim.

On 2015-09-11 08:55, Shetty, Pradeep wrote:

> I have one question:
> 
> Is ceph rbd protocol supported by default on libvirt version 
> 0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd 
> within cloudstack.
> 
> Regards,
> Pradeep
> 
> -----Original Message-----
> From: Vadim Kimlaychuk [mailto:vadim@kickcloud.net]
> Sent: 09 September 2015 12:07
> To: users@cloudstack.apache.org
> Cc: Shetty, Pradeep
> Subject: RE: Unable to add Ceph KVM node in cloudstack
> 
> Pradeep,
> 
> I have installed CS 4.2 with Ceph storage successfully around year ago. 
> There were no problem with configuration except the fact that you can't 
> configure RBD storage as primary storage during Zone set-up.
> It must be NFS.
> After Zone is set-up and running you may add another primary storage 
> and there you have list of choices where RBD type is present.
> After RBD is added you may assign this as default storage for 
> particular cluster assuming that each cluster has its own primary 
> storage.
> 
> PS. I have also used Ceph object gateway to connect secondary storage. 
> It works as expected. It would be nice to know which way are you going 
> to integrate Ceph into CS?
> 
> Vadim.
> 
> On 2015-09-09 08:09, Shetty, Pradeep wrote:
> 
>> Please share steps for adding ceph RBD as primary storage using KVM
>> hypervisor in cloudstack.
>> 
>> We are well aware of the best practices/recommendations for 
>> cloudstack.
>> 
>> Regards,
>> Pradeep
>> 
>> -----Original Message-----
>> From: Vadim Kimlaychuk [mailto:vadim@kickcloud.net]
>> Sent: 08 September 2015 12:14
>> To: users@cloudstack.apache.org
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>> 
>> Pradeep,
>> 
>> From documentation :
>> Warning -- It is NOT recommended to run services on this host not
>> controlled by CloudStack.
>> 
>> Good practice -- KVM host must be virgin-clean.
>> 
>> Vadim.
>> 
>> On 2015-09-08 09:14, Shetty, Pradeep wrote:
>> 
>> Hello Vadim,
>> 
>> We have followed the same guide and using OVS version 2.3.2 .
>> 
>> Ceph storage cluster is running on same KVM hypervisor and it fails
>> when adding to cloudstack.
>> 
>> Regards,
>> Pradeep
>> 
>> -----Original Message-----
>> From: Vadim Kimlaychuk [mailto:vadim@kickcloud.net]
>> Sent: 08 September 2015 11:34
>> To: users@cloudstack.apache.org
>> Cc: Shetty, Pradeep
>> Subject: Re: Unable to add Ceph KVM node in cloudstack
>> 
>> Hello Shetty,
>> 
>> It seems you agent or libvirt configuration is wrong. Please, specify
>> also do you use OVS or Linux bridge?
>> Did you follow this guide?
>> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
>> [1]
>> [1 [1]]
>> m.html
>> [1 [2]]
>> 
>> Regards,
>> 
>> Vadim
>> 
>> On 2015-09-08 08:18, Shetty, Pradeep wrote:
>> 
>> Hello Folks,
>> 
>> We are working on ceph(hammer, 0.94.3) implementation on kvm
>> hypervisor(centos 6.5) which will be integrated on cloudstack(4.4.2),
>> 
>> --- Single KVM node( OS- CentOS 6.5, libvirt-0.10.2-54.el6.x86_64,
>> openvswitch 2.3.2) + ceph hammer, cluster health is Ok.
>> 
>> We are unable to add the KVM host(new cluster) in cloudstack in an
>> existing zone, below is the error log.
>> 
>> ----> agent log-- libvirt: XML-RPC error : Cannot write data: Broken
>> pipe
>> 03/09/2015 13:13:15 4882 jsvc.exec error: Service exit with a return
>> value of 143
>> 
>> Please let us know the exact steps to add Ceph KVM host to cloudstack.
>> 
>> Thanks,
>> Pradeep
> 
> Links:
> ------
> [1]
> 
> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html 
> [2]
> [2 [2]]
> 
> Links:
> ------
> [1]
> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
> [1]
> [2]
> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html 
> [2]


Links:
------
[1] 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
[2] 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html