cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrija Panic <andrija.pa...@gmail.com>
Subject Re: SystemVM (kvm) : 3 different versions for the same CloudStack version (4.5.1)
Date Fri, 29 May 2015 00:09:40 GMT
Hi Pierre,

yes Im aware of that mifration, but we tried to deploy zone from
scratch...anyway, with hacking the DB, it was fine later, but we postoned
S3 testing for some later stage, and will use probably the migration path
as you suggested.

Thx !

On 29 May 2015 at 01:39, Pierre-Luc Dion <pdion@cloudops.com> wrote:

> Andrija,
>
> Can you redeploy using the 4.5.1 systemvm template and an NFS as secondary
> Storage, then use this API:
>
> http://cloudstack.apache.org/api/apidocs-4.5/root_admin/updateCloudToUseObjectStore.html
>  to migrate from NFS to S3 ? Did try that once and had success, you can
> refer to "60 Recipes for Apache CloudStack" which provide an example.  I
> guest this should be part of documentation on using Swift and S3 :-S
>
>
>
>
>
> On Thu, May 28, 2015 at 7:25 PM, Andrija Panic <andrija.panic@gmail.com>
> wrote:
>
> > ". there is reference
> > to cloud.com repos as well, and this is into the database of
> CloudStack."
> >
> > BTW, systemVM 4.5.1 on cloud.com is broken, cat /etc/*release gives
> > version
> > 4.4, and VR fails to start...(we used S3 Secondary Store for testing, so
> > could not download from apt or shapeblue...
> >
> >
> >
> > On 29 May 2015 at 01:19, Pierre-Luc Dion <pdion@cloudops.com> wrote:
> >
> > > Hi,
> > >
> > > I'm pretty aligned with Rajani concerns, which is why I've always used
> > > apt-get.eu as repo in the docs. Also, recent RCs I've participate,
> > testers
> > > were using systemvm-template from jenkins so systemvm-templates that
> end
> > up
> > > on apt-get.eu repo are tested one copied from Jenkins. there is
> > reference
> > > to cloud.com repos as well, and this is into the database of
> > CloudStack. I
> > > think it would add trust if we would have only one community repo with
> > > something like repo.cloudstack.apache.org or anything else that would
> > not
> > > be tie to a third party entity and mirror would be welcome.
> > >
> > > I think this is valid for package (dep,rpm) as well because at the
> moment
> > > when we have RC or GA release, it not clear what package should be use
> > > between jenkins, apt-get.eu or shapeblue :-S
> > >
> > > Yes, for the doc on building systemvm template, should we have a jira
> for
> > > this?, but pull request is best ;-), the best doc I've found so far
> about
> > > this is this blog post: http://bhaisaab.org/logs/building-systemvms/
> > >
> > > Regards,
> > >
> > >
> > > On Thu, May 28, 2015 at 4:10 PM, Milamber <milamber@apache.org> wrote:
> > >
> > > > Hello Rohit,
> > > >
> > > > I've tried your process, but my debian7/CS4.51 doesn't work well.
> > > >
> > > > (I have changed in the database, table vm_template, the type USER to
> > > > SYSTEM for the sharpeblue systemvm and SYSTEM to USER for the old
> > > systemvm)
> > > >
> > > > The Console proxy starts well, but the SSVM started only after 3
> manual
> > > > destroy/create (virsh reset don't solve the issue)
> > > >
> > > > I think it was a Debian/Libvirt issue.
> > > >
> > > > This afternoon, I've re-install my test environment with Ubuntu
> > 14.04(.2)
> > > > to replace Debian7+backports. The CS 4.5.1 works very well, the
> > CPVM/SSVM
> > > > has started speedy and at the first try.
> > > >
> > > > Thanks for your assistance.
> > > > (And thank you for the ability to have virtualization inside
> > > > virtualization (kvm) feature in 4.5! :-))
> > > >
> > > > Milamber
> > > >
> > > >
> > > > On 27/05/2015 10:04, Rohit Yadav wrote:
> > > >
> > > >> Hi Milamber,
> > > >>
> > > >> You can try this:
> > > >>
> > > >> Upgrade your current host with latest packages libvirt/qemu and
> > kernel.
> > > >> My test host was on Ubuntu 14.04.2, so your issue could be something
> > > due to
> > > >> Debian 7.x which ships with much older packages compared to my test
> > > host,
> > > >> I’ll try to test with a Debian 7 host later this week.
> > > >>
> > > >> 1. You may need to remove any cached qcow2 image in the primary
> > storage
> > > >> (usually there will be a file with same md5sum as the current 4.5
> > > systemvm
> > > >> template).
> > > >>
> > > >> 2. Preseed the systemvm template again
> > > >>
> > > >> 3. Check value of router.template.kvm in global settings to confirm
> > the
> > > >> current systemvm template in use, then grab it’s template id and
> > > pre-seed
> > > >> the template again manually using -F:
> > > >>
> > > >>
> > >
> >
> /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt
> > > >> -m /export/secondary/ -f <4.5 systemvmtemplate file downloaded
from
> > > >> http://packages.shapeblue.com/systemvmtemplate/4.5> -h kvm -o
> > localhost
> > > >> -r cloud -d cloudpassword -F
> > > >>
> > > >> 4. Now destroy old systemvms and report if you face the same issue.
> > > >>
> > > >> I’m planning to refresh the systemvmtemplate with latest builds
> after
> > > >> doing some tests in about 2 weeks time.
> > > >>
> > > >>  On 25-May-2015, at 2:14 pm, Milamber <milamber@apache.org>
wrote:
> > > >>>
> > > >>>
> > > >>>
> > > >>> On 25/05/2015 11:56, Rohit Yadav wrote:
> > > >>>
> > > >>>> Hi Milamber,
> > > >>>>
> > > >>>> In theory you should be able to use any of the systemvmtemplates
> and
> > > >>>> also from jenkins.buildacloud.org, but the one I published
on
> > > >>>> packages.shapeblue.com is the latest and has the few additional
> > > >>>> improvements, latest packages and security updates.
> > > >>>>
> > > >>> Ok so it's better to use the shapeblue systemvm.
> > > >>>
> > > >>>
> > > >>>  I’ve tested this and it seems to have worked for me on Ubuntu
> 14.04
> > > >>>> based host,
> > > >>>>
> > > >>> Debian 7 + backports enabled. It's works fine with CS 4.4
> (probably I
> > > >>> will re-install with Ubuntu 14.04.1)
> > > >>>
> > > >>>    can you share what is your KVM host like, distro, libvirt/qemu
> > > >>>> version and kernel version?
> > > >>>>
> > > >>> ipxe-qemu 1.0.0+git-20131111.c3d1e78-2.1~bpo70+1
> > > >>> libvirt-bin 1.2.9-9~bpo70+1
> > > >>> libvirt-clients 1.2.9-9~bpo70+1
> > > >>> libvirt-daemon 1.2.9-9~bpo70+1
> > > >>> libvirt-daemon-system 1.2.9-9~bpo70+1
> > > >>> libvirt0 1.2.9-9~bpo70+1
> > > >>> linux-image-3.2.0-4-amd64 3.2.68-1+deb7u1
> > > >>> linux-image-amd64 3.2+46
> > > >>> python-libvirt 1.2.1-2~bpo70+1
> > > >>> qemu-kvm 1:2.1+dfsg-12~bpo70+1
> > > >>> qemu-system-common 1:2.1+dfsg-12~bpo70+1
> > > >>> qemu-system-x86 1:2.1+dfsg-12~bpo70+1
> > > >>> qemu-utils 1:2.1+dfsg-12~bpo70+1
> > > >>>
> > > >>>
> > > >>>
> > > >>>  Was the host Intel-VT or AMD-V enabled, or was it virtualized
(KVM
> > on
> > > >>>> KVM/Xen/VMWare)?
> > > >>>>
> > > >>> Intel-VT
> > > >>> model name    : Intel(R) Core(TM)2 Duo CPU     P8700  @ 2.53GHz
> > > >>> flags        : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr
pge
> > mca
> > > >>> cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe
> > syscall
> > > nx
> > > >>> lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf
pni
> > > dtes64
> > > >>> monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave
> > > lahf_lm
> > > >>> ida dtherm tpr_shadow vnmi flexpriority
> > > >>>
> > > >>>
> > > >>>
> > > >>>  What is the time and timezone on your host and if kvmclock was
> > > >>>> disable/enabled on the kvm host?
> > > >>>>
> > > >>> Timezone : Africa/Casablanca
> > > >>>
> > > >>> kvm clock NO
> > > >>> cat
> /sys/devices/system/clocksource/clocksource0/current_clocksource
> > > >>> hpet
> > > >>>
> > > >>>
> > > >>>
> > > >>>  Lastly, can you also share if the SSVM gets stuck indefinitely
or
> > you
> > > >>>> did not wait that long and decided to reboot it?
> > > >>>>
> > > >>> I decided to reboot after at least 10 minutes after the Cleaning
> > > message
> > > >>> display on console (not reboot: don't work, virsh reset
> > instance_name)
> > > >>>
> > > >>>
> > > >>>  Regarding the upgrade path, it does not matter really. Since
you
> > > >>>> register 4.5 template before upgrading the upgrade path would
> simply
> > > check
> > > >>>> if a systemvm template exists for currently used unique
> hypervisors
> > > (it
> > > >>>> does that by checking for current hosts with distinct hypervisors
> > from
> > > >>>> cluster table). The checksums and URLs are in there for adding
> rows
> > > in the
> > > >>>> db in case you decide to add a new hypervisor host and it
needs to
> > > donwload
> > > >>>> a suitable template for that new hypervisor. There are on-going
> > > discussion
> > > >>>> on improving the upgrade process so this issue may be addressed
in
> > > that.
> > > >>>>
> > > >>> Ok thanks for the explain.
> > > >>> Only "systemvm-kvm-4.5" in the template before the update is
> > relevant.
> > > >>>
> > > >>> Milamber
> > > >>>
> > > >>>
> > > >>>  On 25-May-2015, at 9:13 am, Milamber <milamber@apache.org>
wrote:
> > > >>>>>
> > > >>>>> Hello,
> > > >>>>>
> > > >>>>> There have 3 different versions of the SystemVM image
for
> > CloudStack
> > > >>>>> 4.5.1 (for KVM, but I assumed that concerns other hypervisors)
> > > >>>>>
> > > >>>>> 1/ shapeblue.com version on Upgrade 4.5.1 from 4.4 page
[1]
> > > >>>>>
> > > >>>>> 2/ apt-get.eu version on Installation Management Server
Page [2]
> > > >>>>>
> > > >>>>> 3/ cloud.com version in com.cloud.upgrade.dao.Upgrade442to450
> > class
> > > >>>>> [3] (Used for the upgrade process from 4.4.2-3 to 4.5.1)
> > > >>>>>
> > > >>>>> The checksums are different:
> > > >>>>> 1 - 5b6d9f276bc1faf50d2fe839c3c7dc5a
> > > >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> > > >>>>> 2 - c3f5d60fbc4a6af7e85c94bb776f2778
> > > >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> > > >>>>> 3 - aa9f501fecd3de1daeb9e2f357f6f002
> > > >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> > > >>>>>
> > > >>>>> The date/size (of the Qcow2 inside) too:
> > > >>>>> 1 - -rw-r--r-- 1 milamber milamber 312669696 May    5
01:40
> > > >>>>> systemvm64template-4.5-kvm.qcow2
> > > >>>>> 2 - -rw-r--r-- 1 milamber milamber 303972352 Mar   7 12:21
> > > >>>>> systemvm64template-4.5-kvm.qcow2
> > > >>>>> 3 - -rw-r--r-- 1 milamber milamber 305387008 Sep  4  2014
> > > >>>>> systemvm64template-4.5-kvm.qcow2
> > > >>>>>
> > > >>>>>
> > > >>>>> I'm not sure if that's relevant, but yesterday, my upgrade
from
> > 4.4.3
> > > >>>>> to 4.5.1 is failed when I would re-create a virtual router
(using
> > the
> > > >>>>> cloud.com version). I have tried to recreate SSVM and
CPVM
> without
> > > >>>>> success too)
> > > >>>>> (Installation type: Adv Network without SG)
> > > >>>>>
> > > >>>>> I made a re-installation of my test platform with a fresh
4.5.1
> > > >>>>> version with shapeblue version (more recent), failed too
on the
> > > start of
> > > >>>>> SSVM (blocked on "Cleaning up temporary files..."), after
1
> manual
> > VM
> > > >>>>> reset, the SSVM started, but the first VR have the same
problem
> and
> > > the
> > > >>>>> reset don't work like the SSVM.
> > > >>>>> (Installation type: Adv Network with SG)
> > > >>>>>
> > > >>>>> I made another re-installation of the test platform with
a fresh
> > > 4.5.1
> > > >>>>> with apt-get.eu version. OK for SSVM but need to do 1
reset for
> > the
> > > >>>>> first VR (and the second VR too).
> > > >>>>> (Installation type: Adv Network without SG)
> > > >>>>>
> > > >>>>>
> > > >>>>> That is relevant?
> > > >>>>>
> > > >>>>> What is the good version?
> > > >>>>>
> > > >>>>> That is a bug for the freeze on "Cleaning up temporary
files"?
> > > >>>>>
> > > >>>>> Why the Systemvm checksum is hard-coded in the class?
If I had
> make
> > > my
> > > >>>>> upgrade with the shapeblue or apt-get.eu version I think
an
> error
> > > >>>>> will be occur on Upgrade process?
> > > >>>>>
> > > >>>>>
> > > >>>>> Milamber
> > > >>>>>
> > > >>>>> ====
> > > >>>>> [1]
> > > >>>>>
> > >
> >
> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.5.1/upgrade/upgrade-4.4.html#update-system-vm-templates
> > > >>>>> [2]
> > > >>>>>
> > >
> >
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.5/management-server/index.html#prepare-the-system-vm-template
> > > >>>>> [3]
> > > >>>>>
> > >
> >
> https://github.com/apache/cloudstack/blob/master/engine/schema/src/com/cloud/upgrade/dao/Upgrade442to450.java#L229
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>>  Regards,
> > > >>>> Rohit Yadav
> > > >>>> Software Architect, ShapeBlue
> > > >>>> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
> > > >>>> Blog: bhaisaab.org | Twitter: @_bhaisaab
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Find out more about ShapeBlue and our range of CloudStack
related
> > > >>>> services
> > > >>>>
> > > >>>> IaaS Cloud Design & Build<
> > > >>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> > > >>>> CSForge – rapid IaaS deployment framework<
> > > http://shapeblue.com/csforge/
> > > >>>> >
> > > >>>> CloudStack Consulting<
> http://shapeblue.com/cloudstack-consultancy/>
> > > >>>> CloudStack Software Engineering<
> > > >>>> http://shapeblue.com/cloudstack-software-engineering/>
> > > >>>> CloudStack Infrastructure Support<
> > > >>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> > > >>>> CloudStack Bootcamp Training Courses<
> > > >>>> http://shapeblue.com/cloudstack-training/>
> > > >>>>
> > > >>>> This email and any attachments to it may be confidential and
are
> > > >>>> intended solely for the use of the individual to whom it is
> > > addressed. Any
> > > >>>> views or opinions expressed are solely those of the author
and do
> > not
> > > >>>> necessarily represent those of Shape Blue Ltd or related
> companies.
> > > If you
> > > >>>> are not the intended recipient of this email, you must neither
> take
> > > any
> > > >>>> action based upon its contents, nor copy or show it to anyone.
> > Please
> > > >>>> contact the sender if you believe you have received this email
in
> > > error.
> > > >>>> Shape Blue Ltd is a company incorporated in England &
Wales.
> > ShapeBlue
> > > >>>> Services India LLP is a company incorporated in India and
is
> > operated
> > > under
> > > >>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria
Ltda
> is a
> > > >>>> company incorporated in Brasil and is operated under license
from
> > > Shape
> > > >>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by
The
> > > Republic of
> > > >>>> South Africa and is traded under license from Shape Blue Ltd.
> > > ShapeBlue is
> > > >>>> a registered trademark.
> > > >>>>
> > > >>>
> > > >>>  Regards,
> > > >> Rohit Yadav
> > > >> Software Architect, ShapeBlue
> > > >> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
> > > >> Blog: bhaisaab.org | Twitter: @_bhaisaab
> > > >>
> > > >>
> > > >>
> > > >> Find out more about ShapeBlue and our range of CloudStack related
> > > services
> > > >>
> > > >> IaaS Cloud Design & Build<
> > > >> http://shapeblue.com/iaas-cloud-design-and-build//>
> > > >> CSForge – rapid IaaS deployment framework<
> > http://shapeblue.com/csforge/
> > > >
> > > >> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> > > >> CloudStack Software Engineering<
> > > >> http://shapeblue.com/cloudstack-software-engineering/>
> > > >> CloudStack Infrastructure Support<
> > > >> http://shapeblue.com/cloudstack-infrastructure-support/>
> > > >> CloudStack Bootcamp Training Courses<
> > > >> http://shapeblue.com/cloudstack-training/>
> > > >>
> > > >> This email and any attachments to it may be confidential and are
> > > intended
> > > >> solely for the use of the individual to whom it is addressed. Any
> > views
> > > or
> > > >> opinions expressed are solely those of the author and do not
> > necessarily
> > > >> represent those of Shape Blue Ltd or related companies. If you are
> not
> > > the
> > > >> intended recipient of this email, you must neither take any action
> > based
> > > >> upon its contents, nor copy or show it to anyone. Please contact the
> > > sender
> > > >> if you believe you have received this email in error. Shape Blue Ltd
> > is
> > > a
> > > >> company incorporated in England & Wales. ShapeBlue Services India
> LLP
> > > is a
> > > >> company incorporated in India and is operated under license from
> Shape
> > > Blue
> > > >> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
in
> > > Brasil
> > > >> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty
> > Ltd
> > > is
> > > >> a company registered by The Republic of South Africa and is traded
> > under
> > > >> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> > > >>
> > > >
> > > >
> > > >
> > >
> >
> >
> >
> > --
> >
> > Andrija Panić
> >
>



-- 

Andrija Panić

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message