cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pierre-Luc Dion <pd...@cloudops.com>
Subject Re: SystemVM (kvm) : 3 different versions for the same CloudStack version (4.5.1)
Date Thu, 28 May 2015 23:39:23 GMT
Andrija,

Can you redeploy using the 4.5.1 systemvm template and an NFS as secondary
Storage, then use this API:
http://cloudstack.apache.org/api/apidocs-4.5/root_admin/updateCloudToUseObjectStore.html
 to migrate from NFS to S3 ? Did try that once and had success, you can
refer to "60 Recipes for Apache CloudStack" which provide an example.  I
guest this should be part of documentation on using Swift and S3 :-S





On Thu, May 28, 2015 at 7:25 PM, Andrija Panic <andrija.panic@gmail.com>
wrote:

> ". there is reference
> to cloud.com repos as well, and this is into the database of CloudStack."
>
> BTW, systemVM 4.5.1 on cloud.com is broken, cat /etc/*release gives
> version
> 4.4, and VR fails to start...(we used S3 Secondary Store for testing, so
> could not download from apt or shapeblue...
>
>
>
> On 29 May 2015 at 01:19, Pierre-Luc Dion <pdion@cloudops.com> wrote:
>
> > Hi,
> >
> > I'm pretty aligned with Rajani concerns, which is why I've always used
> > apt-get.eu as repo in the docs. Also, recent RCs I've participate,
> testers
> > were using systemvm-template from jenkins so systemvm-templates that end
> up
> > on apt-get.eu repo are tested one copied from Jenkins. there is
> reference
> > to cloud.com repos as well, and this is into the database of
> CloudStack. I
> > think it would add trust if we would have only one community repo with
> > something like repo.cloudstack.apache.org or anything else that would
> not
> > be tie to a third party entity and mirror would be welcome.
> >
> > I think this is valid for package (dep,rpm) as well because at the moment
> > when we have RC or GA release, it not clear what package should be use
> > between jenkins, apt-get.eu or shapeblue :-S
> >
> > Yes, for the doc on building systemvm template, should we have a jira for
> > this?, but pull request is best ;-), the best doc I've found so far about
> > this is this blog post: http://bhaisaab.org/logs/building-systemvms/
> >
> > Regards,
> >
> >
> > On Thu, May 28, 2015 at 4:10 PM, Milamber <milamber@apache.org> wrote:
> >
> > > Hello Rohit,
> > >
> > > I've tried your process, but my debian7/CS4.51 doesn't work well.
> > >
> > > (I have changed in the database, table vm_template, the type USER to
> > > SYSTEM for the sharpeblue systemvm and SYSTEM to USER for the old
> > systemvm)
> > >
> > > The Console proxy starts well, but the SSVM started only after 3 manual
> > > destroy/create (virsh reset don't solve the issue)
> > >
> > > I think it was a Debian/Libvirt issue.
> > >
> > > This afternoon, I've re-install my test environment with Ubuntu
> 14.04(.2)
> > > to replace Debian7+backports. The CS 4.5.1 works very well, the
> CPVM/SSVM
> > > has started speedy and at the first try.
> > >
> > > Thanks for your assistance.
> > > (And thank you for the ability to have virtualization inside
> > > virtualization (kvm) feature in 4.5! :-))
> > >
> > > Milamber
> > >
> > >
> > > On 27/05/2015 10:04, Rohit Yadav wrote:
> > >
> > >> Hi Milamber,
> > >>
> > >> You can try this:
> > >>
> > >> Upgrade your current host with latest packages libvirt/qemu and
> kernel.
> > >> My test host was on Ubuntu 14.04.2, so your issue could be something
> > due to
> > >> Debian 7.x which ships with much older packages compared to my test
> > host,
> > >> I’ll try to test with a Debian 7 host later this week.
> > >>
> > >> 1. You may need to remove any cached qcow2 image in the primary
> storage
> > >> (usually there will be a file with same md5sum as the current 4.5
> > systemvm
> > >> template).
> > >>
> > >> 2. Preseed the systemvm template again
> > >>
> > >> 3. Check value of router.template.kvm in global settings to confirm
> the
> > >> current systemvm template in use, then grab it’s template id and
> > pre-seed
> > >> the template again manually using -F:
> > >>
> > >>
> >
> /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt
> > >> -m /export/secondary/ -f <4.5 systemvmtemplate file downloaded from
> > >> http://packages.shapeblue.com/systemvmtemplate/4.5> -h kvm -o
> localhost
> > >> -r cloud -d cloudpassword -F
> > >>
> > >> 4. Now destroy old systemvms and report if you face the same issue.
> > >>
> > >> I’m planning to refresh the systemvmtemplate with latest builds after
> > >> doing some tests in about 2 weeks time.
> > >>
> > >>  On 25-May-2015, at 2:14 pm, Milamber <milamber@apache.org> wrote:
> > >>>
> > >>>
> > >>>
> > >>> On 25/05/2015 11:56, Rohit Yadav wrote:
> > >>>
> > >>>> Hi Milamber,
> > >>>>
> > >>>> In theory you should be able to use any of the systemvmtemplates
and
> > >>>> also from jenkins.buildacloud.org, but the one I published on
> > >>>> packages.shapeblue.com is the latest and has the few additional
> > >>>> improvements, latest packages and security updates.
> > >>>>
> > >>> Ok so it's better to use the shapeblue systemvm.
> > >>>
> > >>>
> > >>>  I’ve tested this and it seems to have worked for me on Ubuntu 14.04
> > >>>> based host,
> > >>>>
> > >>> Debian 7 + backports enabled. It's works fine with CS 4.4 (probably
I
> > >>> will re-install with Ubuntu 14.04.1)
> > >>>
> > >>>    can you share what is your KVM host like, distro, libvirt/qemu
> > >>>> version and kernel version?
> > >>>>
> > >>> ipxe-qemu 1.0.0+git-20131111.c3d1e78-2.1~bpo70+1
> > >>> libvirt-bin 1.2.9-9~bpo70+1
> > >>> libvirt-clients 1.2.9-9~bpo70+1
> > >>> libvirt-daemon 1.2.9-9~bpo70+1
> > >>> libvirt-daemon-system 1.2.9-9~bpo70+1
> > >>> libvirt0 1.2.9-9~bpo70+1
> > >>> linux-image-3.2.0-4-amd64 3.2.68-1+deb7u1
> > >>> linux-image-amd64 3.2+46
> > >>> python-libvirt 1.2.1-2~bpo70+1
> > >>> qemu-kvm 1:2.1+dfsg-12~bpo70+1
> > >>> qemu-system-common 1:2.1+dfsg-12~bpo70+1
> > >>> qemu-system-x86 1:2.1+dfsg-12~bpo70+1
> > >>> qemu-utils 1:2.1+dfsg-12~bpo70+1
> > >>>
> > >>>
> > >>>
> > >>>  Was the host Intel-VT or AMD-V enabled, or was it virtualized (KVM
> on
> > >>>> KVM/Xen/VMWare)?
> > >>>>
> > >>> Intel-VT
> > >>> model name    : Intel(R) Core(TM)2 Duo CPU     P8700  @ 2.53GHz
> > >>> flags        : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
> mca
> > >>> cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe
> syscall
> > nx
> > >>> lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf pni
> > dtes64
> > >>> monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave
> > lahf_lm
> > >>> ida dtherm tpr_shadow vnmi flexpriority
> > >>>
> > >>>
> > >>>
> > >>>  What is the time and timezone on your host and if kvmclock was
> > >>>> disable/enabled on the kvm host?
> > >>>>
> > >>> Timezone : Africa/Casablanca
> > >>>
> > >>> kvm clock NO
> > >>> cat /sys/devices/system/clocksource/clocksource0/current_clocksource
> > >>> hpet
> > >>>
> > >>>
> > >>>
> > >>>  Lastly, can you also share if the SSVM gets stuck indefinitely or
> you
> > >>>> did not wait that long and decided to reboot it?
> > >>>>
> > >>> I decided to reboot after at least 10 minutes after the Cleaning
> > message
> > >>> display on console (not reboot: don't work, virsh reset
> instance_name)
> > >>>
> > >>>
> > >>>  Regarding the upgrade path, it does not matter really. Since you
> > >>>> register 4.5 template before upgrading the upgrade path would simply
> > check
> > >>>> if a systemvm template exists for currently used unique hypervisors
> > (it
> > >>>> does that by checking for current hosts with distinct hypervisors
> from
> > >>>> cluster table). The checksums and URLs are in there for adding
rows
> > in the
> > >>>> db in case you decide to add a new hypervisor host and it needs
to
> > donwload
> > >>>> a suitable template for that new hypervisor. There are on-going
> > discussion
> > >>>> on improving the upgrade process so this issue may be addressed
in
> > that.
> > >>>>
> > >>> Ok thanks for the explain.
> > >>> Only "systemvm-kvm-4.5" in the template before the update is
> relevant.
> > >>>
> > >>> Milamber
> > >>>
> > >>>
> > >>>  On 25-May-2015, at 9:13 am, Milamber <milamber@apache.org> wrote:
> > >>>>>
> > >>>>> Hello,
> > >>>>>
> > >>>>> There have 3 different versions of the SystemVM image for
> CloudStack
> > >>>>> 4.5.1 (for KVM, but I assumed that concerns other hypervisors)
> > >>>>>
> > >>>>> 1/ shapeblue.com version on Upgrade 4.5.1 from 4.4 page [1]
> > >>>>>
> > >>>>> 2/ apt-get.eu version on Installation Management Server Page
[2]
> > >>>>>
> > >>>>> 3/ cloud.com version in com.cloud.upgrade.dao.Upgrade442to450
> class
> > >>>>> [3] (Used for the upgrade process from 4.4.2-3 to 4.5.1)
> > >>>>>
> > >>>>> The checksums are different:
> > >>>>> 1 - 5b6d9f276bc1faf50d2fe839c3c7dc5a
> > >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> > >>>>> 2 - c3f5d60fbc4a6af7e85c94bb776f2778
> > >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> > >>>>> 3 - aa9f501fecd3de1daeb9e2f357f6f002
> > >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> > >>>>>
> > >>>>> The date/size (of the Qcow2 inside) too:
> > >>>>> 1 - -rw-r--r-- 1 milamber milamber 312669696 May    5 01:40
> > >>>>> systemvm64template-4.5-kvm.qcow2
> > >>>>> 2 - -rw-r--r-- 1 milamber milamber 303972352 Mar   7 12:21
> > >>>>> systemvm64template-4.5-kvm.qcow2
> > >>>>> 3 - -rw-r--r-- 1 milamber milamber 305387008 Sep  4  2014
> > >>>>> systemvm64template-4.5-kvm.qcow2
> > >>>>>
> > >>>>>
> > >>>>> I'm not sure if that's relevant, but yesterday, my upgrade
from
> 4.4.3
> > >>>>> to 4.5.1 is failed when I would re-create a virtual router
(using
> the
> > >>>>> cloud.com version). I have tried to recreate SSVM and CPVM
without
> > >>>>> success too)
> > >>>>> (Installation type: Adv Network without SG)
> > >>>>>
> > >>>>> I made a re-installation of my test platform with a fresh 4.5.1
> > >>>>> version with shapeblue version (more recent), failed too on
the
> > start of
> > >>>>> SSVM (blocked on "Cleaning up temporary files..."), after 1
manual
> VM
> > >>>>> reset, the SSVM started, but the first VR have the same problem
and
> > the
> > >>>>> reset don't work like the SSVM.
> > >>>>> (Installation type: Adv Network with SG)
> > >>>>>
> > >>>>> I made another re-installation of the test platform with a
fresh
> > 4.5.1
> > >>>>> with apt-get.eu version. OK for SSVM but need to do 1 reset
for
> the
> > >>>>> first VR (and the second VR too).
> > >>>>> (Installation type: Adv Network without SG)
> > >>>>>
> > >>>>>
> > >>>>> That is relevant?
> > >>>>>
> > >>>>> What is the good version?
> > >>>>>
> > >>>>> That is a bug for the freeze on "Cleaning up temporary files"?
> > >>>>>
> > >>>>> Why the Systemvm checksum is hard-coded in the class? If I
had make
> > my
> > >>>>> upgrade with the shapeblue or apt-get.eu version I think an
error
> > >>>>> will be occur on Upgrade process?
> > >>>>>
> > >>>>>
> > >>>>> Milamber
> > >>>>>
> > >>>>> ====
> > >>>>> [1]
> > >>>>>
> >
> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.5.1/upgrade/upgrade-4.4.html#update-system-vm-templates
> > >>>>> [2]
> > >>>>>
> >
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.5/management-server/index.html#prepare-the-system-vm-template
> > >>>>> [3]
> > >>>>>
> >
> https://github.com/apache/cloudstack/blob/master/engine/schema/src/com/cloud/upgrade/dao/Upgrade442to450.java#L229
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>>  Regards,
> > >>>> Rohit Yadav
> > >>>> Software Architect, ShapeBlue
> > >>>> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
> > >>>> Blog: bhaisaab.org | Twitter: @_bhaisaab
> > >>>>
> > >>>>
> > >>>>
> > >>>> Find out more about ShapeBlue and our range of CloudStack related
> > >>>> services
> > >>>>
> > >>>> IaaS Cloud Design & Build<
> > >>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>> CSForge – rapid IaaS deployment framework<
> > http://shapeblue.com/csforge/
> > >>>> >
> > >>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> > >>>> CloudStack Software Engineering<
> > >>>> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>> CloudStack Infrastructure Support<
> > >>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>> CloudStack Bootcamp Training Courses<
> > >>>> http://shapeblue.com/cloudstack-training/>
> > >>>>
> > >>>> This email and any attachments to it may be confidential and are
> > >>>> intended solely for the use of the individual to whom it is
> > addressed. Any
> > >>>> views or opinions expressed are solely those of the author and
do
> not
> > >>>> necessarily represent those of Shape Blue Ltd or related companies.
> > If you
> > >>>> are not the intended recipient of this email, you must neither
take
> > any
> > >>>> action based upon its contents, nor copy or show it to anyone.
> Please
> > >>>> contact the sender if you believe you have received this email
in
> > error.
> > >>>> Shape Blue Ltd is a company incorporated in England & Wales.
> ShapeBlue
> > >>>> Services India LLP is a company incorporated in India and is
> operated
> > under
> > >>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda
is a
> > >>>> company incorporated in Brasil and is operated under license from
> > Shape
> > >>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The
> > Republic of
> > >>>> South Africa and is traded under license from Shape Blue Ltd.
> > ShapeBlue is
> > >>>> a registered trademark.
> > >>>>
> > >>>
> > >>>  Regards,
> > >> Rohit Yadav
> > >> Software Architect, ShapeBlue
> > >> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
> > >> Blog: bhaisaab.org | Twitter: @_bhaisaab
> > >>
> > >>
> > >>
> > >> Find out more about ShapeBlue and our range of CloudStack related
> > services
> > >>
> > >> IaaS Cloud Design & Build<
> > >> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >> CSForge – rapid IaaS deployment framework<
> http://shapeblue.com/csforge/
> > >
> > >> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> > >> CloudStack Software Engineering<
> > >> http://shapeblue.com/cloudstack-software-engineering/>
> > >> CloudStack Infrastructure Support<
> > >> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >> CloudStack Bootcamp Training Courses<
> > >> http://shapeblue.com/cloudstack-training/>
> > >>
> > >> This email and any attachments to it may be confidential and are
> > intended
> > >> solely for the use of the individual to whom it is addressed. Any
> views
> > or
> > >> opinions expressed are solely those of the author and do not
> necessarily
> > >> represent those of Shape Blue Ltd or related companies. If you are not
> > the
> > >> intended recipient of this email, you must neither take any action
> based
> > >> upon its contents, nor copy or show it to anyone. Please contact the
> > sender
> > >> if you believe you have received this email in error. Shape Blue Ltd
> is
> > a
> > >> company incorporated in England & Wales. ShapeBlue Services India LLP
> > is a
> > >> company incorporated in India and is operated under license from Shape
> > Blue
> > >> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> > Brasil
> > >> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty
> Ltd
> > is
> > >> a company registered by The Republic of South Africa and is traded
> under
> > >> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> > >>
> > >
> > >
> > >
> >
>
>
>
> --
>
> Andrija Panić
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message