From dev-return-111777-archive-asf-public=cust-asf.ponee.io@cloudstack.apache.org Fri Jul 27 21:13:19 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 21B28180657 for ; Fri, 27 Jul 2018 21:13:18 +0200 (CEST) Received: (qmail 25845 invoked by uid 500); 27 Jul 2018 19:13:17 -0000 Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list dev@cloudstack.apache.org Received: (qmail 25828 invoked by uid 99); 27 Jul 2018 19:13:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Jul 2018 19:13:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id B40ADC18E8 for ; Fri, 27 Jul 2018 19:13:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.869 X-Spam-Level: * X-Spam-Status: No, score=1.869 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id DW9QN1t05FBQ for ; Fri, 27 Jul 2018 19:13:14 +0000 (UTC) Received: from mail-oi0-f51.google.com (mail-oi0-f51.google.com [209.85.218.51]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 1DAEC5F107 for ; Fri, 27 Jul 2018 19:13:14 +0000 (UTC) Received: by mail-oi0-f51.google.com with SMTP id w126-v6so10912177oie.7 for ; Fri, 27 Jul 2018 12:13:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=71WegrMGr/d19D9H66ET98tYx+h2K8w8WurKDRRUCVY=; b=ZVqsR818kHiF6VUMvQf2kZkUD3KiQIvZZOe1wfeD6Y4zrr6walyTTBgK55TvPIM5/b JegXkbL59RY8XVxxQhd27/ZgjJOs5jSBDLvAXN6wN1r7r6rE3NXhDAdwc04jGoFwr5JY tpZNj1KPXgCPzm8wsXADaqg/B/K6aXd+ASYMcqc145ss/QxOutdAA1VDQzm08iGAl37C VWOHGuz+smGyn8pCgmigUnDSqSOLt/SqTZ+W0hNagDwZsS9DEmBHVKAipRcSBM49Rr87 PS0T2M9rn/Ydk1H3NKW5qDOQYat/YFMAaDs6AukKH5FYU1fTb/btzUIU85IP6jyt/4kz vrgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=71WegrMGr/d19D9H66ET98tYx+h2K8w8WurKDRRUCVY=; b=QGFmME9iDP6i6DO0igPFAqU6hltQJ3Gi+C+bNrZc8r93WhypuEQR662aZ9ksa45lF8 o9xi1z2pskavqeivzcnHs74RnJr1cvs7q5qkQKCj2pwhL3fGfj8ZAaUclOYnwT4wzrAX tM8kCW+hrlqwBG5pa1pBg0uJEaGmq3M6s7xyIWDgJURb666iIac8LcTaCW/0fjrOTXDw gFTK3xqTZFRegcDcwL7KcnJ+hOYzlWZ45Pllb2FOjY8MRjRADmS6ABDC77ZAB1m4FUGp ycm9Snp9dea0wJHCxhdDpcPZ+L+/oZMrMcZhB76A6mRw3fuv30JQGf5tNjMv9ygBrboS LXEw== X-Gm-Message-State: AOUpUlGNkLhq4mNdQIpuz58B+r65aK/TCbFJPthUOjJR1stFBstnTW+m CW++9H9s+UIoFk66vzZwi9VxqCKY57ou3Di/e/LkiQ== X-Google-Smtp-Source: AAOMgpf4YnKEqb3GzUpfknZkqdLX0lGqnvIELIe7apXxtDNUzTpmOBxJRe4SWqlgyiYNsyyp03yCiJF/lmKjlQVZQHY= X-Received: by 2002:aca:3a03:: with SMTP id h3-v6mr7561527oia.270.1532718793259; Fri, 27 Jul 2018 12:13:13 -0700 (PDT) MIME-Version: 1.0 References: <614bf6a8-0e10-3b9c-f8e0-77a4d2c4ecd5@widodh.nl> <7ADF9BE5-F674-42E8-AB57-F5FE95C1F1D9@shapeblue.com> In-Reply-To: From: Andrija Panic Date: Fri, 27 Jul 2018 21:13:02 +0200 Message-ID: Subject: Re: CEPH / CloudStack features To: dev Content-Type: multipart/alternative; boundary="0000000000003680e80571ffe7a5" --0000000000003680e80571ffe7a5 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Dag, I'm a bit too late to really share something not mentioned already above - but in general most things work - (VM snapshots not...) - but all else is there (resizing volumes, downloading volumes, templates, snapshots, etc), live migration, etc - we use this with Ubuntu 14 stock libraries (recently upgraded to versions from 16.04) - some features were originally missing (volume resize of root vs data volumes), and hopefully the RAW vs QCOW2 format inside DB (what a mess... :) ), is also solved (we did back in the days a lot of small internal patches, that were never validated with community unfortunately - don't ask me why - beside proper snapshots lifecycle (part of 4.8 an onwards) (i.e. keep really only last 1 snap on CEPH, instead of 50+ garbage snapshots), etc. If you need more precise info - I could even organize a small demo account for you with private CEPH offering for VM and DATA (don't tell anyone :) ) - so you can actually see it yourself... Cheers Andrija On Fri, 27 Jul 2018 at 16:28, Simon Weller wrote: > They're volume based snapshots at this point. We've looked at what it > would take to support VMsnapshots, but we're not there yet, as the memory > would need to be stored outside of the actual volume. > > Primary snapshots work well. We still need to reintroduce the code that > allows for disabling primary to secondary coping of snapshots should an > organization not want to do that. > > > Templates are also pre-cached into Ceph to speed up deployment of VMs as > Wido indicates below. This greatly reduced the secondary to primary copyi= ng > of template images. > Live migration works well land has since Wido introduced the Ceph feature= s > years ago. > > We have started looking at what it would take to support Ceph volume > replication between zones/regions, as that would be a great Business > Continuity feature. > > > ________________________________ > From: Dag Sonstebo > Sent: Friday, July 27, 2018 8:32 AM > To: dev@cloudstack.apache.org > Subject: Re: CEPH / CloudStack features > > Excellent, thanks Wido. > > When you say snapshotting =E2=80=93 is this VM snapshots, volume snapshot= s or both? > > How about live migration, does this work? > > Regards, > Dag Sonstebo > Cloud Architect > ShapeBlue > > On 27/07/2018, 13:41, "Wido den Hollander" wrote: > > Hi, > > On 07/27/2018 12:18 PM, Dag Sonstebo wrote: > > Hi all, > > > > I=E2=80=99m trying to find out more about CEPH compatibility with C= loudStack > / KVM =E2=80=93 i.e. trying to put together a feature matrix of what work= s and > what doesn=E2=80=99t compared to NFS (or other block storage platforms). > > There=E2=80=99s not a lot of up to date information on this =E2=80= =93 the > configuration guide on [1] is all I=E2=80=99ve located so far apart from = a couple > of one-liners in the official documentation. > > > > Could I get some feedback from the Ceph users in the community? > > > > Yes! So, at first, Ceph is KVM-only. Other hypervisors do not support > RBD (RADOS Block Device) from Ceph. > > What is supported: > > - Thin provisioning > - Discard / fstrim (Requires VirtIO-SCSI) > - Volume cloning > - Snapshots > - Disk I/O throttling (done by libvirt) > > Meaning, when a template is deployed for the first time in a Primary > Storage it's written to Ceph and all other Instances afterwards are a > clone of that primary image. > > You can snapshot a RBD image and then have it copied to Secondary > Storage. Now, I'm not sure if keeping the snapshot in Primary Storage > and reverting works yet, I haven't looked at that in recent times. > > The snapshotting part on Primary Storage is probably something that > needs some love and attention, but otherwise I think all other featur= es > are supported. > > I would recommend a CentOS 7 or Ubuntu 16.04/18.04 hypervisor, both > work > just fine with Ceph. > > Wido > > > Regards, > > Dag Sonstebo > > > > [1] http://docs.ceph.com/docs/master/rbd/rbd-cloudstack/ > > > > Dag.Sonstebo@shapeblue.com > > www.shapeblue.com > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > > @shapeblue > > > > > > > > > > Dag.Sonstebo@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > @shapeblue > > > > --=20 Andrija Pani=C4=87 --0000000000003680e80571ffe7a5--