Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
Received-SPF: pass (nike.apache.org: domain of shadowsor@gmail.com designates
 209.85.212.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <1674F150-4F00-4119-ADF4-69A2C2E9CDA2@citrix.com>
References: <CE99CEF1.4D7D1%min.chen@citrix.com>
	<CALFpzo57R9JYmN1zzLgfhF_1xEVSxoisB1uhn-P-xymp_yW0gA@mail.gmail.com>
	<1674F150-4F00-4119-ADF4-69A2C2E9CDA2@citrix.com>
Date: Sat, 2 Nov 2013 10:25:02 -0600
Message-ID: 
 <CALFpzo5dB1fW_KEKHEx373MRiXJ5fN02VHNreFTrAGk6vopwaw@mail.gmail.com>
Subject: Re: S3 as secondary storage is broken in master
From: Marcus Sorensen <shadowsor@gmail.com>
To: Min Chen <min.chen@citrix.com>
Cc: dev@cloudstack.apache.org, "SuichII,
 Christopher" <Chris.Suich@netapp.com>,
	Edison Su <Edison.su@citrix.com>
Content-Type: multipart/alternative; boundary=047d7b6d7aaef8d27a04ea341f32

--047d7b6d7aaef8d27a04ea341f32
Content-Type: text/plain; charset=ISO-8859-1

OK. I was thinking that S3 was acting as secondary storage now but really
it still requires NFS as the intermediary, hence the "image cache". In that
case your suggestion would work.
On Nov 2, 2013 10:10 AM, "Min Chen" <min.chen@citrix.com> wrote:

> No, Marcus. That piece of code worked in 4.2 for S3. Note that image ache
> store is also NfsTO.
>
> Thanks
> -min
>
> Sent from my iPhone
>
> > On Nov 2, 2013, at 7:18 AM, "Marcus Sorensen" <shadowsor@gmail.com>
> wrote:
> >
> > My only issue is that I believe  copyTemplateToPrimaryStorage fails if
> > the source datastore is not NfsTO, so I'm not sure if this change will
> > do anything, or where S3 copy is actually handled. se
> > copyTemplateToPrimaryStorage:
> >
> > KVM:
> >        if (!(imageStore instanceof NfsTO)) {
> >            return new CopyCmdAnswer("unsupported protocol");
> >        }
> >
> > Xen (all logic wrapped in this if statement):
> >           if ((srcStore instanceof NfsTO) && (srcData.getObjectType()
> > == DataObjectType.TEMPLATE)) {
> >
> > VMware:
> >        if (!(srcStore instanceof NfsTO)) {
> >            return new CopyCmdAnswer("unsupported protocol");
> >        }
> >
> > This line of code has a history. In 4.2 it didn't work for S3, either.
> > It specifically only allowed NFS:
> >
> > if ((srcData.getObjectType() == DataObjectType.TEMPLATE) &&
> > (srcDataStore instanceof NfsTO)  && (destData.getDataStore().getRole()
> > == DataStoreRole.Primary)) {
> >
> > Then for a short while it was changed during some refactoring Chris
> > and Edison were working on:
> >
> > if ((srcData.getObjectType() == DataObjectType.TEMPLATE) &&
> > (destData.getObjectType() == DataObjectType.TEMPLATE &&
> > destData.getDataStore().getRole() == DataStoreRole.Primary)) {
> >
> > That broke CLVM, so I changed it to:
> >
> > if (srcData.getObjectType() == DataObjectType.TEMPLATE &&
> > srcData.getDataStore().getRole() == DataStoreRole.Image &&
> > destData.getDataStore().getRole() == DataStoreRole.Primary) {
> >
> >> On Fri, Nov 1, 2013 at 10:34 PM, Min Chen <min.chen@citrix.com> wrote:
> >> Hi Marcus,
> >>
> >> Your commit a504c004bf10555e5ea67ec89fe7bf6f00fe4622 broke S3
> functionality.
> >> With S3 as secondary storage, system vm cannot be started. Since for S3,
> >> copy template to primary will be from an ImageCache store. Your
> following
> >> line of code :
> >>
> >>      if (srcData.getObjectType() == DataObjectType.TEMPLATE &&
> >> srcData.getDataStore().getRole() == DataStoreRole.Image &&
> >> destData.getDataStore().getRole() == DataStoreRole.Primary) {
> >>             //copy template to primary storage
> >>             return processor.copyTemplateToPrimaryStorage(cmd);
> >>         }
> >>
> >> will not cover this case. I saw that you mentioned about this commit in
> >> another thread about CLVM broken in master. To fix this problem,  we can
> >> change the above line to:
> >>
> >>      if (srcData.getObjectType() == DataObjectType.TEMPLATE &&
> >> (srcData.getDataStore().getRole() == DataStoreRole.Image ||
> >> srcData.getDataStore().getRole() == DataStoreRole.ImageCache) &&
> >> destData.getDataStore().getRole() == DataStoreRole.Primary) {
> >>             //copy template to primary storage
> >>             return processor.copyTemplateToPrimaryStorage(cmd);
> >>         }
> >>
> >> Edison/Chris, do you see any issue with this fix?
> >>
> >> Thanks
> >> -min
>

--047d7b6d7aaef8d27a04ea341f32--