cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nux! <...@li.nux.ro>
Subject Re: Migrating CloudStack content from download.cloud.com
Date Wed, 18 May 2016 16:34:00 GMT
Yes, I was also thinking of the mirrorlist; I would not host it on gh, it needs to be pretty
HA. :)

imho

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

----- Original Message -----
> From: "Erik Weber" <terbolous@gmail.com>
> To: dev@cloudstack.apache.org
> Sent: Wednesday, 18 May, 2016 17:32:22
> Subject: Re: Migrating CloudStack content from download.cloud.com

> In case it was unclear, i meant hosting the mirrorlist with gh Pages :-)
> 
> Den onsdag 18. mai 2016 skrev Will Stevens <williamstevens@gmail.com>
> følgende:
> 
>> Haha. I thought of that and didn't want to mention it because I thought it
>> would be too fragile and not very ASFy. But if we have a
>> ​ mirror
>> ​ list, it would be a good option as one of the items in the list as a
>> backup.
>>
>>
>> On May 18, 2016 8:33 AM, "Erik Weber" <terbolous@gmail.com <javascript:;>>
>> wrote:
>>
>> I guess we could even host it with github pages?
>>
>> On Wed, May 18, 2016 at 2:28 PM, Will Stevens <williamstevens@gmail.com
>> <javascript:;>>
>> wrote:
>>
>> > I like this approach as well. Seems like a nice solution and builds in
>> > redundancy if a specific mirror is down for some reason.
>> > On May 18, 2016 4:06 AM, "Paul Angus" <paul.angus@shapeblue.com
>> <javascript:;>> wrote:
>> >
>> > > Pulling a few threads together - if the ASF would create a
>> > > download.cloudstack.org page on ASF infra with the mirrorlist json in
>> it
>> > > as suggested by Nux, we can maintain just that page and add/remove
>> > mirrors
>> > > at will.
>> > >
>> > >
>> > > Kind regards,
>> > >
>> > > Paul Angus
>> > >
>> > > paul.angus@shapeblue.com <javascript:;>
>> > > www.shapeblue.com
>> > > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>> > > @shapeblue
>> > >
>> > >
>> > >
>> > > -----Original Message-----
>> > > From: Wido den Hollander [mailto:wido@widodh.nl <javascript:;>]
>> > > Sent: 18 May 2016 08:37
>> > > To: Giles Sirett <giles.sirett@shapeblue.com <javascript:;>>;
>> dev@cloudstack.apache.org <javascript:;>
>> > > Subject: RE: Migrating CloudStack content from download.cloud.com
>> > >
>> > >
>> > > > Op 17 mei 2016 om 10:34 schreef Giles Sirett <
>> > giles.sirett@shapeblue.com <javascript:;>
>> > > >:
>> > > >
>> > > >
>> > > > This is a MAJOR problem and needs to be figured out before the
>> current
>> > > download site is removed - @Raja - have Citrix committed to it being
>> > there
>> > > another year ?
>> > > >
>> > > > It is my understanding that Cloudstack relies on this download at
>> > > > initial build/startup and then periodically if people do things like
>> > > > build a new zone
>> > > >
>> > > > So, users environments aren't going to stop if its pulled, but nobody
>> > > > would be a able to build/install cloudstack and it may cause issues
>> as
>> > > > and when users make config changes
>> > > >
>> > > > The problem is, for new builds, its hard coded : you start the  Sec
>> > > > Storage VM, CloudStack will try to download the built in template
>> from
>> > > > download.cloud.com
>> > > >
>> > > > My understanding is that its simple db  change to make once an
>> > > > environment is running (exisiting users) but *may* require a code
>> > > > patch to fix the initial install
>> > > >
>> > > > #notideal
>> > > >
>> > > > Really, this should be maintained by ASF/ the project as its key to
>> > > > the software working, however my understanding is it involves
>> binaries
>> > > > which ASF is never keen on (and may be some 3rd party binaries) -
so
>> > > > that just wont happen
>> > > >
>> > > >
>> > > >
>> > > > Apt-get is controlled by Wido et al (for which we all owe him a
>> massive
>> > > thanks)  - but you are right, it is a 3rd party dependency and arguably
>> a
>> > > SPOF.  But, if ASF wont host binaries, we're always going to have this
>> > > issue.
>> > > >
>> > >
>> > > Fully agree with you. I'am happy to host this, but for the project it
>> is
>> > a
>> > > danger. The domain name should be controlled by the project.
>> > >
>> > > > So, we could patch the code to point somewhere else - but where ?
-
>> by
>> > > > definition its got to be something maintained by a 3rd party
>> > > >
>> > > >
>> > > > We had this debate some time ago when talking about the repositories.
>> > We
>> > > (ShapeBlue) maintain a repo for our customers, which wev'e always
>> opened
>> > up
>> > > as public. However, there were concerns about having a company domain
>> > name
>> > > (which I understand) - so apt-get became our preferred repo.
>> > > >
>> > > >
>> > > > Thoughts on how to fix this:
>> > > >
>> > > > 1. if ASF would allow us to create the host entry
>> > > > download.cloudstack.org. Its under their domain, but with the site
>> > > > being with a 3rd party it could be allowed
>> > > >
>> > >
>> > > I think that would be the best. A CNAME pointing to
>> > cloudstack.apt-get.eu
>> > > for now might be enough.
>> > >
>> > > > 2. maybe Citrix could commit to pointing the current DNS entry to
a
>> > > > new location (would be simplest but may be legally complex and relies
>> > > > on ongoing goodwill)
>> > > >
>> > > > 3. make a mod to allow users to choose the download location on
>> > > > install. We can then maintain apt-get. To remove the SPOF, we could
>> > > > then get the templates copied to a number of 3rd party locations and
>> > > > allow people to choose which one they use
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > Kind Regards
>> > > > Giles
>> > > >
>> > > >
>> > > > giles.sirett@shapeblue.com <javascript:;>
>> > > > www.shapeblue.com
>> > > > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
>> > > >
>> > > >
>> > > >
>> > > > -----Original Message-----
>> > > > From: williamstevens@gmail.com <javascript:;> [mailto:
>> williamstevens@gmail.com <javascript:;>] On
>> > > Behalf Of Will Stevens
>> > > > Sent: 16 May 2016 18:59
>> > > > To: dev@cloudstack.apache.org <javascript:;>
>> > > > Cc: Wido den Hollander <wido@widodh.nl <javascript:;>>
>> > > > Subject: Re: Migrating CloudStack content from download.cloud.com
>> > > >
>> > > > @Ian, yes, but I think there is more to it than that.  We can change
>> it
>> > > going forward and we can move everything from there over to a new
>> domain.
>> > > > I believe the problem is with all of the existing ACS or CCP installs
>> > > out there currently pointing at the download.cloud.com URL, so when it
>> > > goes down, those installs have to be updated.
>> > > >
>> > > > Maybe I don't understand exactly, but that is the impression I am
>> > > getting from this thread.  Can this be confirmed?
>> > > >
>> > > > *Will STEVENS*
>> > > > Lead Developer
>> > > >
>> > > > *CloudOps* *| *Cloud Solutions Experts
>> > > > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|*
>> tw
>> > > @CloudOps_
>> > > >
>> > > > On Mon, May 16, 2016 at 1:38 PM, Ian Rae <irae@cloudops.com
>> <javascript:;>> wrote:
>> > > >
>> > > > > Hey guys, who controls apt-get.eu and given the (rather
>> concerning)
>> > > > > level of dependency on the operation of the download.cloud.com
-
>> > would
>> > > > > it not make sense to use a domain that is under the control of
>> party
>> > > > > whose alignment with CloudStack will not shift. I hesitate to
>> > > > > implicate the red tape of Apache Foundation, but perhaps the
fabled
>> > > > > CloudStack alliance organization would be a good way to handle
this
>> > > > > long term.
>> > > > >
>> > > > > On Mon, May 16, 2016 at 1:32 PM, Raja Pullela
>> > > > > <raja.pullela@accelerite.com <javascript:;>> wrote:
>> > > > > > Paul,
>> > > > > >
>> > > > > > trust me, it won’t be go away overnight.  We are talking
to
>> Citrix
>> > > > > > and
>> > > > > requested them to keep it active for another year.
>> > > > > >
>> > > > > > Once we have the content copied over (I will work with Wido
and
>> > > > > > verify
>> > > > > this) to cloudstack.apt-get.eu and update the documentation (user
>> > > > > guides update and create a wiki to show how an existing
>> installation
>> > > > > can fixed to point to new URLs) we don’t have a dependency
on “
>> > > download.cloud.com” –
>> > > > > right?  sorry, if I am missing something here?   Please let me
>> know,
>> > > > > >
>> > > > > > best,
>> > > > > > Raja
>> > > > > > Senior Manager, Product Development
>> > > > > > Accelerite,
>> > > > > > 2055, Laurelwood Road,  Santa Clara, CA 95054, USA
>> > > > > > Phone: 1-408-216-7010,  www.accelerite.com, @accelerite
>> > > > > >
>> > > > > >
>> > > > > > On 5/16/16, 9:38 PM, "Paul Angus" <paul.angus@shapeblue.com
>> <javascript:;>>
>> > wrote:
>> > > > > >>Thanks Raja,
>> > > > > >>
>> > > > > >>May I humbly suggest that someone at Accelerite speaks
to Citrix
>> > > > > >>about
>> > > > > how long the content will remain on download.cloud.com?
>> > > > > >>Simply losing the content on download.cloud.com overnight
will
>> > make
>> > > > > everyone look bad
>> > > > > >>
>> > > > > >>Kind regards,
>> > > > > >>
>> > > > > >>Paul Angus
>> > > > > >>
>> > > > > >>paul.angus@shapeblue.com <javascript:;>
>> > > > > >>www.shapeblue.com
>> > > > > >>53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
>> > > > > >>
>> > > > > >>-----Original Message-----
>> > > > > >>From: Raja Pullela [mailto:raja.pullela@accelerite.com
>> <javascript:;>]
>> > > > > >>Sent: 16 May 2016 16:44
>> > > > > >>To: dev@cloudstack.apache.org <javascript:;>
>> > > > > >>Subject: Re: Migrating CloudStack content from
>> download.cloud.com
>> > > > > >>
>> > > > > >>Paul,
>> > > > > >>
>> > > > > >>Yes, you are right, this change impacts both CloudStack
and
>> > > > > CloudPlatform customers.  Not sure, if I understand you correctly,
>> > the
>> > > > > move away from “download.cloud.com” is permanent.  I don’t
know
>> how
>> > > > > long the content on download.cloud.com will be up/available.
>> > > > > >>
>> > > > > >>Based on Wido’s availability, we can get rest of the
content to
>> > > > > cloudstack.apt-get.eu, hopefully, by this week ?    BTW, the
>> content
>> > > on
>> > > > > download.cloud.com is left as is and will stay as is until Citrix
>> > > > > decides on what to do with it.
>> > > > > >>
>> > > > > >>Best,
>> > > > > >>Raja
>> > > > > >>Senior Manager, Product Development
>> > > > > >>Accelerite,
>> > > > > >>2055, Laurelwood Road,  Santa Clara, CA 95054, USA
>> > > > > >>Phone: 1-408-216-7010,  www.accelerite.com, @accelerite
>> > > > > >>
>> > > > > >>
>> > > > > >>On 5/16/16, 6:36 PM, "Paul Angus" <paul.angus@shapeblue.com
>> <javascript:;>>
>> > wrote:
>> > > > > >>
>> > > > > >>>Raja,
>> > > > > >>>
>> > > > > >>>As this effects every copy of CloudStack and CloudPlatform
there
>> > > > > >>>ever
>> > > > > was.  Please may I ask how long we have to manage a migration
away
>> > > > > from download.cloud.com?
>> > > > > >>>
>> > > > > >>>
>> > > > > >>>
>> > > > > >>>Kind regards,
>> > > > > >>>
>> > > > > >>>Paul Angus
>> > > > > >>>
>> > > > > >>>Regards,
>> > > > > >>>
>> > > > > >>>Paul Angus
>> > > > > >>>
>> > > > > >>>paul.angus@shapeblue.com <javascript:;>
>> > > > > >>>www.shapeblue.com
>> > > > > >>>53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
>> > > > > >>>
>> > > > > >>>-----Original Message-----
>> > > > > >>>From: Raja Pullela [mailto:raja.pullela@accelerite.com
>> <javascript:;>]
>> > > > > >>>Sent: 16 May 2016 13:53
>> > > > > >>>To: dev@cloudstack.apache.org <javascript:;>
>> > > > > >>>Subject: Re: Migrating CloudStack content from
>> download.cloud.com
>> > > > > >>>
>> > > > > >>>Hi Paul,
>> > > > > >>>
>> > > > > >>>Thank you for the additional file details and I will
request
>> wido
>> > > > > >>>to
>> > > > > copy these as well.
>> > > > > >>>
>> > > > > >>>BTW, I agree with you there is every copy of CloudStack
out
>> there
>> > > > > >>>and
>> > > > > reason why I have requested Wido to download all the old files
as
>> > well.
>> > > > > Looks like we missed few and get these uploaded as well.
>> > > > > >>>
>> > > > > >>>Please note that Citrix owns the “download.cloud.com”
address
>> and
>> > > > > >>>we
>> > > > > have to get all the CloudStack related content from there.  Once
we
>> > > > > confirm on the content move Citrix may choose to remove the content
>> > > > > from the location.
>> > > > > >>>
>> > > > > >>>That said, I will get in touch with Wido again and
do a complete
>> > > > > >>>copy
>> > > > > such that we have everything.
>> > > > > >>>
>> > > > > >>>Best,
>> > > > > >>>Raja
>> > > > > >>>Senior Manager, Product Development Accelerite, 2055,
Laurelwood
>> > > > > >>>Road,  Santa Clara, CA 95054, USA
>> > > > > >>>Phone: 1-408-216-7010,  www.accelerite.com, @accelerite
>> > > > > >>>
>> > > > > >>>On 5/14/16, 7:12 AM, "Paul Angus" <paul.angus@shapeblue.com
>> <javascript:;>>
>> > wrote:
>> > > > > >>>>Raja,
>> > > > > >>>>
>> > > > > >>>>I've just picked up on this.
>> > > > > >>>>
>> > > > > >>>>There are a number of URLs which are hardcoded
into the
>> > CloudStack
>> > > > > database for the small built-in templates.  These are in just
about
>> > > > > every copy of CloudStack out there.
>> > > > > >>>>
>> > > > > >>>>
>> > http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd
>> > > > > >>>>2-f8
>> > > > > >>>>4
>> > > > > >>>>755767aca.vhd.bz2
>> > > > > >>>>
>> > http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c
>> > > > > >>>>001b
>> > > > > >>>>d
>> > > > > >>>>8a0faf.qcow2.bz2
>> > > > > >>>>
>> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz
>> > > > > >>>>2
>> > > > > >>>>http://download.cloud.com/releases/4.3/centos6_4_64bit.vhd.bz2
>> > > > > >>>>http://download.cloud.com/releases/2.2.0/CentOS5.3-x86_64.ova
>> > > > > >>>>
>> > http://download.cloud.com/templates/builtin/centos-7-x86_64.tar.gz
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>These will need copying and the CloudStack code
updating to the
>> > > > > >>>>new
>> > > > > location.
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>I don't think that you can deprecate download.cloud.com
or
>> it's
>> > > > > contents for some time, without causing a lot of issues for users.
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>Hi,
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>Short Term - all the content has moved to
>> cloudstack.apt-get.eu
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>Which sections to be modified?
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>The Install Guide needs to be modified.  Sample
links/details
>> are
>> > > > > >>>>mentioned below for 4.6 and same needs to be
updated for other
>> > > > > >>>>Released versions of Cloudstack documentation:
>> > > > > >>>>
>> > > > > >>>>
>> > http://docs.cloudstack.apache.org/projects/cloudstack-installation
>> > > > > >>>>/en/
>> > > > > >>>>4 .6/management-server/#downloading-vhd-util
>> > > > > >>>>
>> > > > > >>>>Section - Downloading vhd-util¶
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>What to do modified ?
>> > > > > >>>>
>> > > > > >>>>modify URL from
>> > > > > >>>>http://download.cloud.com.s3.amazonaws.com/tools/vhd-util
to
>> > > > > >>>>http://cloudstack.apt-get.eu/tools/vhd-util
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>@Rajsekhar can you please update the sections
?
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>Thanks
>> > > > > >>>>
>> > > > > >>>>Raja
>> > > > > >>>>
>> > > > > >>>>Senior Manager, Product Development
>> > > > > >>>>
>> > > > > >>>>Accelerite,
>> > > > > >>>>
>> > > > > >>>>2055, Laurelwood Road,  Santa Clara, CA 95054,
USA
>> > > > > >>>>
>> > > > > >>>>Phone: 1-408-216-7010,  www.accelerite.com, @accelerite
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>Kind regards,
>> > > > > >>>>
>> > > > > >>>>Paul Angus
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>>Regards,
>> > > > > >>>>
>> > > > > >>>>Paul Angus
>> > > > > >>>>
>> > > > > >>>>paul.angus@shapeblue.com <javascript:;>
>> > > > > >>>>www.shapeblue.com
>> > > > > >>>>53 Chandos Place, Covent Garden, London  WC2N
4HSUK @shapeblue
>> > > > > >>>
>> > > > > >>>
>> > > > > >>>
>> > > > > >>>
>> > > > > >>>DISCLAIMER
>> > > > > >>>==========
>> > > > > >>>This e-mail may contain privileged and confidential
information
>> > > > > >>>which
>> > > > > is the property of Accelerite, a Persistent Systems business.
It is
>> > > > > intended only for the use of the individual or entity to which
it
>> is
>> > > > > addressed. If you are not the intended recipient, you are not
>> > > > > authorized to read, retain, copy, print, distribute or use this
>> > > > > message. If you have received this communication in error, please
>> > > > > notify the sender and delete all copies of this message.
>> Accelerite,
>> > a
>> > > > > Persistent Systems business does not accept any liability for
virus
>> > > infected mails.
>> > > > > >>
>> > > > > >>
>> > > > > >>
>> > > > > >>
>> > > > > >>DISCLAIMER
>> > > > > >>==========
>> > > > > >>This e-mail may contain privileged and confidential information
>> > > > > >>which is
>> > > > > the property of Accelerite, a Persistent Systems business. It
is
>> > > > > intended only for the use of the individual or entity to which
it
>> is
>> > > > > addressed. If you are not the intended recipient, you are not
>> > > > > authorized to read, retain, copy, print, distribute or use this
>> > > > > message. If you have received this communication in error, please
>> > > > > notify the sender and delete all copies of this message.
>> Accelerite,
>> > a
>> > > > > Persistent Systems business does not accept any liability for
virus
>> > > infected mails.
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > DISCLAIMER
>> > > > > > ==========
>> > > > > > This e-mail may contain privileged and confidential information
>> > > > > > which is
>> > > > > the property of Accelerite, a Persistent Systems business. It
is
>> > > > > intended only for the use of the individual or entity to which
it
>> is
>> > > > > addressed. If you are not the intended recipient, you are not
>> > > > > authorized to read, retain, copy, print, distribute or use this
>> > > > > message. If you have received this communication in error, please
>> > > > > notify the sender and delete all copies of this message.
>> Accelerite,
>> > a
>> > > > > Persistent Systems business does not accept any liability for
virus
>> > > infected mails.
>> > > > >
>> > > > >
>> > > > >
>> > > > > --
>> > > > > Ian Rae
>> > > > > CEO | PDG
>> > > > > c: 514.944.4008
>> > > > >
>> > > > > CloudOps | Cloud Infrastructure and Networking Solutions
>> > > > > www.cloudops.com | 420 rue Guy | Montreal | Canada | H3J 1S6
>> > > > >
>> > >
>> >

Mime
View raw message