From users-return-33233-archive-asf-public=cust-asf.ponee.io@cloudstack.apache.org Wed Jul 17 13:30:38 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 79BC918060E for ; Wed, 17 Jul 2019 15:30:38 +0200 (CEST) Received: (qmail 40733 invoked by uid 500); 17 Jul 2019 13:30:35 -0000 Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@cloudstack.apache.org Delivered-To: mailing list users@cloudstack.apache.org Received: (qmail 40665 invoked by uid 99); 17 Jul 2019 13:30:35 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Jul 2019 13:30:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B6C251A3411; Wed, 17 Jul 2019 13:30:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.801 X-Spam-Level: * X-Spam-Status: No, score=1.801 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Z-3L6yE7nYFr; Wed, 17 Jul 2019 13:30:32 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.208.175; helo=mail-lj1-f175.google.com; envelope-from=the.jfnadeau@gmail.com; receiver= Received: from mail-lj1-f175.google.com (mail-lj1-f175.google.com [209.85.208.175]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 658C4BC7AD; Wed, 17 Jul 2019 13:30:32 +0000 (UTC) Received: by mail-lj1-f175.google.com with SMTP id t28so23623242lje.9; Wed, 17 Jul 2019 06:30:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=VW0OJjtst3dX3dVsfZuThSfd08GK87XL+UmS5BmzThE=; b=vgw+OUgbeF1SmMzvijSCKyYwscDppRl+MQcFWHBLkyWFgrCo/cRBjD8T4O7/YWtvlg K49nP2jeFNCGhih8Sj0StJzPbE6k5DUtcMbPAQlv+FosEwYl6qsY2I6NwvX4EBhS2Mr9 pSfV9nVwvgQguPfHyjgrIFMX5pzLqj0pB0MFubYt6ae+hZ2RG6hcgbgJ/lqPPEbtO/N6 Msrw9T0H3PCNoFmgWsKU+tl9CLGAXODkndAjopXwUnezrkJD71jesJncFs6JGesUS7ug ngQuNOINji7yq8UcAzwl6YTHrk5DXZXLeJUPbuIIFciD15+Rw3wVZC7XbIQlM+51wGIy p14Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=VW0OJjtst3dX3dVsfZuThSfd08GK87XL+UmS5BmzThE=; b=HTDk0TTjmniXnI7fzKVTyvdYR2zfUty8FW8vbsNp/DV6hDgASt2MSq4hHnSwuP63qL gBbwglk0VFtYXLwvN2uYrqKfCB7pO6Cstx2rTHtn934q+l95G/qVMF+v6kDhXtmqwW5P 2xKYli2M+qbJHV9eSX9ltQejIdGIf5aPguJi9pVaqIYMVxjMJ9VSkU7vQxQkdHxO7K10 dozPREK8bDh8OyG/4BaxLxrxp+XMITMWvCUVSU1d1ZBrBhtyv+9eCper+Akxo0rTpD2f NeFDzxgdLEpuniz1w8GM2LBdRLz5jsu4J/ICBkPnt8JtwG2c4gj4Px2WevCEQbL+tzE0 S5/g== X-Gm-Message-State: APjAAAXVRRGZOIJsAWG8IqqGzMnTutpfWGjqVbaFHHXCisONw+caKlzG Wo7ut9IxTj0g8FO/n6jMZ8P9nIK3SoF8vxI0UwwNXeRC X-Google-Smtp-Source: APXvYqzsNILNLqlVMvlLHOSdnTWVGzg1zOI30aXLUDPKyyR/Tqe5NecjglvxW0TdfMlXod4S/1QVNGGb1uQCI7KEZi4= X-Received: by 2002:a2e:50e:: with SMTP id 14mr21164653ljf.5.1563370230432; Wed, 17 Jul 2019 06:30:30 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Jean-Francois Nadeau Date: Wed, 17 Jul 2019 09:30:18 -0400 Message-ID: Subject: Re: Using S3/Minio as the only secondary storage To: dev@cloudstack.apache.org Cc: users@cloudstack.apache.org Content-Type: multipart/alternative; boundary="0000000000003cc945058de07f1e" --0000000000003cc945058de07f1e Content-Type: text/plain; charset="UTF-8" Thanks Will, I remember having the discussion with Pierre-Luc on his use of Swift for templates. I was curious about the differences on S3 vs Swift for SS since looking at the CS UI when it comes to setting up an S3 image store... the NFS staging is optional. And this make sense to me if your object storage is fast and accessible locally, why the need for staging/caching. The documentation could mention if it is possible to use S3 secondary and nothing else, starting with if SSVM templates can be uploaded to a bucket. I will certainly ask Syed later today :) best Jfn On Wed, Jul 17, 2019 at 6:59 AM Will Stevens wrote: > Hey JF, > We use the Swift object store as the storage backend for secondary > storage. I have not tried the S3 integration, but the last time I looked > at the code for this (admittedly, a long time ago) the Swift and s3 logic > was more intertwined than I liked. The CloudOps/cloud.ca team had to do a > lot of work to get the Swift integration to a reasonable working state. I > believe all of our changes have been upstreamed quite some time ago. I > don't know if anyone is doing this for the S3 implementation. > > I can't speak to the S3 implementation because I have not looked at it in a > very long time, but the Swift implementation requires a "temporary NFS > staging area" that essentially acts kind of like a buffer between the > object store and primary storage when templates and such are used by the > hosts. > > I think Pierre-Luc and Syed have a clearer picture of all the moving > pieces, but that is a quick summary of what I know without digging in. > > Hope that helps. > > Cheers, > > Will > > On Tue, Jul 16, 2019, 10:24 PM Jean-Francois Nadeau < > the.jfnadeau@gmail.com> > wrote: > > > Hello Everyone, > > > > I was wondering if it was common or even recommended to use an S3 > > compatible storage system as the only secondary storage provider ? > > > > The environment is 4.11.3.0 with KVM (Centos 7.6), and our tier1 storage > > solution also provides an S3 compatible object store (apparently Minio > > under the hood). > > > > I have always used NFS to install the SSVM templates and the install > script > > (cloud-install-sys-tmplt) only takes a mount point. How, if possible, > > would I proceed with S3 only storage ? > > > > best, > > > > Jean-Francois > > > --0000000000003cc945058de07f1e--