Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAD97ioeSKxN05iFwt2nt3MWCDm-XYeaGT9hEYDYBThc6O_7Q5A@mail.gmail.com>
References: <5562CBB5.2000304@apache.org>
	<428A950E-41AF-471F-92DD-4F91C6FA5C23@shapeblue.com>
	<5563121F.4020209@apache.org>
	<1506014C-827B-4744-A229-6048F650F5CA@shapeblue.com>
	<55677623.5050002@apache.org>
	<CAD97ioeSKxN05iFwt2nt3MWCDm-XYeaGT9hEYDYBThc6O_7Q5A@mail.gmail.com>
Date: Fri, 29 May 2015 01:25:50 +0200
Message-ID: 
 <CAMvtBPOhASeq=XX5AhqKsav5cnz3znqeuOeriMDhWU_ZsuR5Dg@mail.gmail.com>
Subject: Re: SystemVM (kvm) : 3 different versions for the same CloudStack
 version (4.5.1)
From: Andrija Panic <andrija.panic@gmail.com>
To: "dev@cloudstack.apache.org" <dev@cloudstack.apache.org>
Content-Type: multipart/alternative; boundary=089e010d916217b92c05172caeb9

--089e010d916217b92c05172caeb9
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

". there is reference
to cloud.com repos as well, and this is into the database of CloudStack."

BTW, systemVM 4.5.1 on cloud.com is broken, cat /etc/*release gives version
4.4, and VR fails to start...(we used S3 Secondary Store for testing, so
could not download from apt or shapeblue...


On 29 May 2015 at 01:19, Pierre-Luc Dion <pdion@cloudops.com> wrote:

> Hi,
>
> I'm pretty aligned with Rajani concerns, which is why I've always used
> apt-get.eu as repo in the docs. Also, recent RCs I've participate, tester=
s
> were using systemvm-template from jenkins so systemvm-templates that end =
up
> on apt-get.eu repo are tested one copied from Jenkins. there is reference
> to cloud.com repos as well, and this is into the database of CloudStack. =
I
> think it would add trust if we would have only one community repo with
> something like repo.cloudstack.apache.org or anything else that would not
> be tie to a third party entity and mirror would be welcome.
>
> I think this is valid for package (dep,rpm) as well because at the moment
> when we have RC or GA release, it not clear what package should be use
> between jenkins, apt-get.eu or shapeblue :-S
>
> Yes, for the doc on building systemvm template, should we have a jira for
> this?, but pull request is best ;-), the best doc I've found so far about
> this is this blog post: http://bhaisaab.org/logs/building-systemvms/
>
> Regards,
>
>
> On Thu, May 28, 2015 at 4:10 PM, Milamber <milamber@apache.org> wrote:
>
> > Hello Rohit,
> >
> > I've tried your process, but my debian7/CS4.51 doesn't work well.
> >
> > (I have changed in the database, table vm_template, the type USER to
> > SYSTEM for the sharpeblue systemvm and SYSTEM to USER for the old
> systemvm)
> >
> > The Console proxy starts well, but the SSVM started only after 3 manual
> > destroy/create (virsh reset don't solve the issue)
> >
> > I think it was a Debian/Libvirt issue.
> >
> > This afternoon, I've re-install my test environment with Ubuntu 14.04(.=
2)
> > to replace Debian7+backports. The CS 4.5.1 works very well, the CPVM/SS=
VM
> > has started speedy and at the first try.
> >
> > Thanks for your assistance.
> > (And thank you for the ability to have virtualization inside
> > virtualization (kvm) feature in 4.5! :-))
> >
> > Milamber
> >
> >
> > On 27/05/2015 10:04, Rohit Yadav wrote:
> >
> >> Hi Milamber,
> >>
> >> You can try this:
> >>
> >> Upgrade your current host with latest packages libvirt/qemu and kernel=
.
> >> My test host was on Ubuntu 14.04.2, so your issue could be something
> due to
> >> Debian 7.x which ships with much older packages compared to my test
> host,
> >> I=E2=80=99ll try to test with a Debian 7 host later this week.
> >>
> >> 1. You may need to remove any cached qcow2 image in the primary storag=
e
> >> (usually there will be a file with same md5sum as the current 4.5
> systemvm
> >> template).
> >>
> >> 2. Preseed the systemvm template again
> >>
> >> 3. Check value of router.template.kvm in global settings to confirm th=
e
> >> current systemvm template in use, then grab it=E2=80=99s template id a=
nd
> pre-seed
> >> the template again manually using -F:
> >>
> >>
> /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-=
tmplt
> >> -m /export/secondary/ -f <4.5 systemvmtemplate file downloaded from
> >> http://packages.shapeblue.com/systemvmtemplate/4.5> -h kvm -o localhos=
t
> >> -r cloud -d cloudpassword -F
> >>
> >> 4. Now destroy old systemvms and report if you face the same issue.
> >>
> >> I=E2=80=99m planning to refresh the systemvmtemplate with latest build=
s after
> >> doing some tests in about 2 weeks time.
> >>
> >>  On 25-May-2015, at 2:14 pm, Milamber <milamber@apache.org> wrote:
> >>>
> >>>
> >>>
> >>> On 25/05/2015 11:56, Rohit Yadav wrote:
> >>>
> >>>> Hi Milamber,
> >>>>
> >>>> In theory you should be able to use any of the systemvmtemplates and
> >>>> also from jenkins.buildacloud.org, but the one I published on
> >>>> packages.shapeblue.com is the latest and has the few additional
> >>>> improvements, latest packages and security updates.
> >>>>
> >>> Ok so it's better to use the shapeblue systemvm.
> >>>
> >>>
> >>>  I=E2=80=99ve tested this and it seems to have worked for me on Ubunt=
u 14.04
> >>>> based host,
> >>>>
> >>> Debian 7 + backports enabled. It's works fine with CS 4.4 (probably I
> >>> will re-install with Ubuntu 14.04.1)
> >>>
> >>>    can you share what is your KVM host like, distro, libvirt/qemu
> >>>> version and kernel version?
> >>>>
> >>> ipxe-qemu 1.0.0+git-20131111.c3d1e78-2.1~bpo70+1
> >>> libvirt-bin 1.2.9-9~bpo70+1
> >>> libvirt-clients 1.2.9-9~bpo70+1
> >>> libvirt-daemon 1.2.9-9~bpo70+1
> >>> libvirt-daemon-system 1.2.9-9~bpo70+1
> >>> libvirt0 1.2.9-9~bpo70+1
> >>> linux-image-3.2.0-4-amd64 3.2.68-1+deb7u1
> >>> linux-image-amd64 3.2+46
> >>> python-libvirt 1.2.1-2~bpo70+1
> >>> qemu-kvm 1:2.1+dfsg-12~bpo70+1
> >>> qemu-system-common 1:2.1+dfsg-12~bpo70+1
> >>> qemu-system-x86 1:2.1+dfsg-12~bpo70+1
> >>> qemu-utils 1:2.1+dfsg-12~bpo70+1
> >>>
> >>>
> >>>
> >>>  Was the host Intel-VT or AMD-V enabled, or was it virtualized (KVM o=
n
> >>>> KVM/Xen/VMWare)?
> >>>>
> >>> Intel-VT
> >>> model name    : Intel(R) Core(TM)2 Duo CPU     P8700  @ 2.53GHz
> >>> flags        : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge m=
ca
> >>> cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscal=
l
> nx
> >>> lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf pni
> dtes64
> >>> monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave
> lahf_lm
> >>> ida dtherm tpr_shadow vnmi flexpriority
> >>>
> >>>
> >>>
> >>>  What is the time and timezone on your host and if kvmclock was
> >>>> disable/enabled on the kvm host?
> >>>>
> >>> Timezone : Africa/Casablanca
> >>>
> >>> kvm clock NO
> >>> cat /sys/devices/system/clocksource/clocksource0/current_clocksource
> >>> hpet
> >>>
> >>>
> >>>
> >>>  Lastly, can you also share if the SSVM gets stuck indefinitely or yo=
u
> >>>> did not wait that long and decided to reboot it?
> >>>>
> >>> I decided to reboot after at least 10 minutes after the Cleaning
> message
> >>> display on console (not reboot: don't work, virsh reset instance_name=
)
> >>>
> >>>
> >>>  Regarding the upgrade path, it does not matter really. Since you
> >>>> register 4.5 template before upgrading the upgrade path would simply
> check
> >>>> if a systemvm template exists for currently used unique hypervisors
> (it
> >>>> does that by checking for current hosts with distinct hypervisors fr=
om
> >>>> cluster table). The checksums and URLs are in there for adding rows
> in the
> >>>> db in case you decide to add a new hypervisor host and it needs to
> donwload
> >>>> a suitable template for that new hypervisor. There are on-going
> discussion
> >>>> on improving the upgrade process so this issue may be addressed in
> that.
> >>>>
> >>> Ok thanks for the explain.
> >>> Only "systemvm-kvm-4.5" in the template before the update is relevant=
.
> >>>
> >>> Milamber
> >>>
> >>>
> >>>  On 25-May-2015, at 9:13 am, Milamber <milamber@apache.org> wrote:
> >>>>>
> >>>>> Hello,
> >>>>>
> >>>>> There have 3 different versions of the SystemVM image for CloudStac=
k
> >>>>> 4.5.1 (for KVM, but I assumed that concerns other hypervisors)
> >>>>>
> >>>>> 1/ shapeblue.com version on Upgrade 4.5.1 from 4.4 page [1]
> >>>>>
> >>>>> 2/ apt-get.eu version on Installation Management Server Page [2]
> >>>>>
> >>>>> 3/ cloud.com version in com.cloud.upgrade.dao.Upgrade442to450 class
> >>>>> [3] (Used for the upgrade process from 4.4.2-3 to 4.5.1)
> >>>>>
> >>>>> The checksums are different:
> >>>>> 1 - 5b6d9f276bc1faf50d2fe839c3c7dc5a
> >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> >>>>> 2 - c3f5d60fbc4a6af7e85c94bb776f2778
> >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> >>>>> 3 - aa9f501fecd3de1daeb9e2f357f6f002
> >>>>> systemvm64template-4.5-kvm.qcow2.bz2
> >>>>>
> >>>>> The date/size (of the Qcow2 inside) too:
> >>>>> 1 - -rw-r--r-- 1 milamber milamber 312669696 May    5 01:40
> >>>>> systemvm64template-4.5-kvm.qcow2
> >>>>> 2 - -rw-r--r-- 1 milamber milamber 303972352 Mar   7 12:21
> >>>>> systemvm64template-4.5-kvm.qcow2
> >>>>> 3 - -rw-r--r-- 1 milamber milamber 305387008 Sep  4  2014
> >>>>> systemvm64template-4.5-kvm.qcow2
> >>>>>
> >>>>>
> >>>>> I'm not sure if that's relevant, but yesterday, my upgrade from 4.4=
.3
> >>>>> to 4.5.1 is failed when I would re-create a virtual router (using t=
he
> >>>>> cloud.com version). I have tried to recreate SSVM and CPVM without
> >>>>> success too)
> >>>>> (Installation type: Adv Network without SG)
> >>>>>
> >>>>> I made a re-installation of my test platform with a fresh 4.5.1
> >>>>> version with shapeblue version (more recent), failed too on the
> start of
> >>>>> SSVM (blocked on "Cleaning up temporary files..."), after 1 manual =
VM
> >>>>> reset, the SSVM started, but the first VR have the same problem and
> the
> >>>>> reset don't work like the SSVM.
> >>>>> (Installation type: Adv Network with SG)
> >>>>>
> >>>>> I made another re-installation of the test platform with a fresh
> 4.5.1
> >>>>> with apt-get.eu version. OK for SSVM but need to do 1 reset for the
> >>>>> first VR (and the second VR too).
> >>>>> (Installation type: Adv Network without SG)
> >>>>>
> >>>>>
> >>>>> That is relevant?
> >>>>>
> >>>>> What is the good version?
> >>>>>
> >>>>> That is a bug for the freeze on "Cleaning up temporary files"?
> >>>>>
> >>>>> Why the Systemvm checksum is hard-coded in the class? If I had make
> my
> >>>>> upgrade with the shapeblue or apt-get.eu version I think an error
> >>>>> will be occur on Upgrade process?
> >>>>>
> >>>>>
> >>>>> Milamber
> >>>>>
> >>>>> =3D=3D=3D=3D
> >>>>> [1]
> >>>>>
> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.=
5.1/upgrade/upgrade-4.4.html#update-system-vm-templates
> >>>>> [2]
> >>>>>
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.5=
/management-server/index.html#prepare-the-system-vm-template
> >>>>> [3]
> >>>>>
> https://github.com/apache/cloudstack/blob/master/engine/schema/src/com/cl=
oud/upgrade/dao/Upgrade442to450.java#L229
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>>  Regards,
> >>>> Rohit Yadav
> >>>> Software Architect, ShapeBlue
> >>>> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
> >>>> Blog: bhaisaab.org | Twitter: @_bhaisaab
> >>>>
> >>>>
> >>>>
> >>>> Find out more about ShapeBlue and our range of CloudStack related
> >>>> services
> >>>>
> >>>> IaaS Cloud Design & Build<
> >>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>> CSForge =E2=80=93 rapid IaaS deployment framework<
> http://shapeblue.com/csforge/
> >>>> >
> >>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >>>> CloudStack Software Engineering<
> >>>> http://shapeblue.com/cloudstack-software-engineering/>
> >>>> CloudStack Infrastructure Support<
> >>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>> CloudStack Bootcamp Training Courses<
> >>>> http://shapeblue.com/cloudstack-training/>
> >>>>
> >>>> This email and any attachments to it may be confidential and are
> >>>> intended solely for the use of the individual to whom it is
> addressed. Any
> >>>> views or opinions expressed are solely those of the author and do no=
t
> >>>> necessarily represent those of Shape Blue Ltd or related companies.
> If you
> >>>> are not the intended recipient of this email, you must neither take
> any
> >>>> action based upon its contents, nor copy or show it to anyone. Pleas=
e
> >>>> contact the sender if you believe you have received this email in
> error.
> >>>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBl=
ue
> >>>> Services India LLP is a company incorporated in India and is operate=
d
> under
> >>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> >>>> company incorporated in Brasil and is operated under license from
> Shape
> >>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The
> Republic of
> >>>> South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue is
> >>>> a registered trademark.
> >>>>
> >>>
> >>>  Regards,
> >> Rohit Yadav
> >> Software Architect, ShapeBlue
> >> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
> >> Blog: bhaisaab.org | Twitter: @_bhaisaab
> >>
> >>
> >>
> >> Find out more about ShapeBlue and our range of CloudStack related
> services
> >>
> >> IaaS Cloud Design & Build<
> >> http://shapeblue.com/iaas-cloud-design-and-build//>
> >> CSForge =E2=80=93 rapid IaaS deployment framework<http://shapeblue.com=
/csforge/
> >
> >> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >> CloudStack Software Engineering<
> >> http://shapeblue.com/cloudstack-software-engineering/>
> >> CloudStack Infrastructure Support<
> >> http://shapeblue.com/cloudstack-infrastructure-support/>
> >> CloudStack Bootcamp Training Courses<
> >> http://shapeblue.com/cloudstack-training/>
> >>
> >> This email and any attachments to it may be confidential and are
> intended
> >> solely for the use of the individual to whom it is addressed. Any view=
s
> or
> >> opinions expressed are solely those of the author and do not necessari=
ly
> >> represent those of Shape Blue Ltd or related companies. If you are not
> the
> >> intended recipient of this email, you must neither take any action bas=
ed
> >> upon its contents, nor copy or show it to anyone. Please contact the
> sender
> >> if you believe you have received this email in error. Shape Blue Ltd i=
s
> a
> >> company incorporated in England & Wales. ShapeBlue Services India LLP
> is a
> >> company incorporated in India and is operated under license from Shape
> Blue
> >> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil
> >> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Lt=
d
> is
> >> a company registered by The Republic of South Africa and is traded und=
er
> >> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >>
> >
> >
> >
>


--=20

Andrija Pani=C4=87

--089e010d916217b92c05172caeb9--