Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
MIME-Version: 1.0
In-Reply-To: <55677623.5050002@apache.org>
References: <5562CBB5.2000304@apache.org>
	<428A950E-41AF-471F-92DD-4F91C6FA5C23@shapeblue.com>
	<5563121F.4020209@apache.org>
	<1506014C-827B-4744-A229-6048F650F5CA@shapeblue.com>
	<55677623.5050002@apache.org>
Date: Thu, 28 May 2015 19:19:14 -0400
Message-ID: 
 <CAD97ioeSKxN05iFwt2nt3MWCDm-XYeaGT9hEYDYBThc6O_7Q5A@mail.gmail.com>
Subject: Re: SystemVM (kvm) : 3 different versions for the same CloudStack
 version (4.5.1)
From: Pierre-Luc Dion <pdion@cloudops.com>
To: "dev@cloudstack.apache.org" <dev@cloudstack.apache.org>
Content-Type: multipart/alternative; boundary=001a113dad8882965d05172c96fc

--001a113dad8882965d05172c96fc
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi,

I'm pretty aligned with Rajani concerns, which is why I've always used
apt-get.eu as repo in the docs. Also, recent RCs I've participate, testers
were using systemvm-template from jenkins so systemvm-templates that end up
on apt-get.eu repo are tested one copied from Jenkins. there is reference
to cloud.com repos as well, and this is into the database of CloudStack. I
think it would add trust if we would have only one community repo with
something like repo.cloudstack.apache.org or anything else that would not
be tie to a third party entity and mirror would be welcome.

I think this is valid for package (dep,rpm) as well because at the moment
when we have RC or GA release, it not clear what package should be use
between jenkins, apt-get.eu or shapeblue :-S

Yes, for the doc on building systemvm template, should we have a jira for
this?, but pull request is best ;-), the best doc I've found so far about
this is this blog post: http://bhaisaab.org/logs/building-systemvms/

Regards,


On Thu, May 28, 2015 at 4:10 PM, Milamber <milamber@apache.org> wrote:

> Hello Rohit,
>
> I've tried your process, but my debian7/CS4.51 doesn't work well.
>
> (I have changed in the database, table vm_template, the type USER to
> SYSTEM for the sharpeblue systemvm and SYSTEM to USER for the old systemv=
m)
>
> The Console proxy starts well, but the SSVM started only after 3 manual
> destroy/create (virsh reset don't solve the issue)
>
> I think it was a Debian/Libvirt issue.
>
> This afternoon, I've re-install my test environment with Ubuntu 14.04(.2)
> to replace Debian7+backports. The CS 4.5.1 works very well, the CPVM/SSVM
> has started speedy and at the first try.
>
> Thanks for your assistance.
> (And thank you for the ability to have virtualization inside
> virtualization (kvm) feature in 4.5! :-))
>
> Milamber
>
>
> On 27/05/2015 10:04, Rohit Yadav wrote:
>
>> Hi Milamber,
>>
>> You can try this:
>>
>> Upgrade your current host with latest packages libvirt/qemu and kernel.
>> My test host was on Ubuntu 14.04.2, so your issue could be something due=
 to
>> Debian 7.x which ships with much older packages compared to my test host=
,
>> I=E2=80=99ll try to test with a Debian 7 host later this week.
>>
>> 1. You may need to remove any cached qcow2 image in the primary storage
>> (usually there will be a file with same md5sum as the current 4.5 system=
vm
>> template).
>>
>> 2. Preseed the systemvm template again
>>
>> 3. Check value of router.template.kvm in global settings to confirm the
>> current systemvm template in use, then grab it=E2=80=99s template id and=
 pre-seed
>> the template again manually using -F:
>>
>> /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys=
-tmplt
>> -m /export/secondary/ -f <4.5 systemvmtemplate file downloaded from
>> http://packages.shapeblue.com/systemvmtemplate/4.5> -h kvm -o localhost
>> -r cloud -d cloudpassword -F
>>
>> 4. Now destroy old systemvms and report if you face the same issue.
>>
>> I=E2=80=99m planning to refresh the systemvmtemplate with latest builds =
after
>> doing some tests in about 2 weeks time.
>>
>>  On 25-May-2015, at 2:14 pm, Milamber <milamber@apache.org> wrote:
>>>
>>>
>>>
>>> On 25/05/2015 11:56, Rohit Yadav wrote:
>>>
>>>> Hi Milamber,
>>>>
>>>> In theory you should be able to use any of the systemvmtemplates and
>>>> also from jenkins.buildacloud.org, but the one I published on
>>>> packages.shapeblue.com is the latest and has the few additional
>>>> improvements, latest packages and security updates.
>>>>
>>> Ok so it's better to use the shapeblue systemvm.
>>>
>>>
>>>  I=E2=80=99ve tested this and it seems to have worked for me on Ubuntu =
14.04
>>>> based host,
>>>>
>>> Debian 7 + backports enabled. It's works fine with CS 4.4 (probably I
>>> will re-install with Ubuntu 14.04.1)
>>>
>>>    can you share what is your KVM host like, distro, libvirt/qemu
>>>> version and kernel version?
>>>>
>>> ipxe-qemu 1.0.0+git-20131111.c3d1e78-2.1~bpo70+1
>>> libvirt-bin 1.2.9-9~bpo70+1
>>> libvirt-clients 1.2.9-9~bpo70+1
>>> libvirt-daemon 1.2.9-9~bpo70+1
>>> libvirt-daemon-system 1.2.9-9~bpo70+1
>>> libvirt0 1.2.9-9~bpo70+1
>>> linux-image-3.2.0-4-amd64 3.2.68-1+deb7u1
>>> linux-image-amd64 3.2+46
>>> python-libvirt 1.2.1-2~bpo70+1
>>> qemu-kvm 1:2.1+dfsg-12~bpo70+1
>>> qemu-system-common 1:2.1+dfsg-12~bpo70+1
>>> qemu-system-x86 1:2.1+dfsg-12~bpo70+1
>>> qemu-utils 1:2.1+dfsg-12~bpo70+1
>>>
>>>
>>>
>>>  Was the host Intel-VT or AMD-V enabled, or was it virtualized (KVM on
>>>> KVM/Xen/VMWare)?
>>>>
>>> Intel-VT
>>> model name    : Intel(R) Core(TM)2 Duo CPU     P8700  @ 2.53GHz
>>> flags        : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca
>>> cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall =
nx
>>> lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf pni dtes=
64
>>> monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave lahf_l=
m
>>> ida dtherm tpr_shadow vnmi flexpriority
>>>
>>>
>>>
>>>  What is the time and timezone on your host and if kvmclock was
>>>> disable/enabled on the kvm host?
>>>>
>>> Timezone : Africa/Casablanca
>>>
>>> kvm clock NO
>>> cat /sys/devices/system/clocksource/clocksource0/current_clocksource
>>> hpet
>>>
>>>
>>>
>>>  Lastly, can you also share if the SSVM gets stuck indefinitely or you
>>>> did not wait that long and decided to reboot it?
>>>>
>>> I decided to reboot after at least 10 minutes after the Cleaning messag=
e
>>> display on console (not reboot: don't work, virsh reset instance_name)
>>>
>>>
>>>  Regarding the upgrade path, it does not matter really. Since you
>>>> register 4.5 template before upgrading the upgrade path would simply c=
heck
>>>> if a systemvm template exists for currently used unique hypervisors (i=
t
>>>> does that by checking for current hosts with distinct hypervisors from
>>>> cluster table). The checksums and URLs are in there for adding rows in=
 the
>>>> db in case you decide to add a new hypervisor host and it needs to don=
wload
>>>> a suitable template for that new hypervisor. There are on-going discus=
sion
>>>> on improving the upgrade process so this issue may be addressed in tha=
t.
>>>>
>>> Ok thanks for the explain.
>>> Only "systemvm-kvm-4.5" in the template before the update is relevant.
>>>
>>> Milamber
>>>
>>>
>>>  On 25-May-2015, at 9:13 am, Milamber <milamber@apache.org> wrote:
>>>>>
>>>>> Hello,
>>>>>
>>>>> There have 3 different versions of the SystemVM image for CloudStack
>>>>> 4.5.1 (for KVM, but I assumed that concerns other hypervisors)
>>>>>
>>>>> 1/ shapeblue.com version on Upgrade 4.5.1 from 4.4 page [1]
>>>>>
>>>>> 2/ apt-get.eu version on Installation Management Server Page [2]
>>>>>
>>>>> 3/ cloud.com version in com.cloud.upgrade.dao.Upgrade442to450 class
>>>>> [3] (Used for the upgrade process from 4.4.2-3 to 4.5.1)
>>>>>
>>>>> The checksums are different:
>>>>> 1 - 5b6d9f276bc1faf50d2fe839c3c7dc5a
>>>>> systemvm64template-4.5-kvm.qcow2.bz2
>>>>> 2 - c3f5d60fbc4a6af7e85c94bb776f2778
>>>>> systemvm64template-4.5-kvm.qcow2.bz2
>>>>> 3 - aa9f501fecd3de1daeb9e2f357f6f002
>>>>> systemvm64template-4.5-kvm.qcow2.bz2
>>>>>
>>>>> The date/size (of the Qcow2 inside) too:
>>>>> 1 - -rw-r--r-- 1 milamber milamber 312669696 May    5 01:40
>>>>> systemvm64template-4.5-kvm.qcow2
>>>>> 2 - -rw-r--r-- 1 milamber milamber 303972352 Mar   7 12:21
>>>>> systemvm64template-4.5-kvm.qcow2
>>>>> 3 - -rw-r--r-- 1 milamber milamber 305387008 Sep  4  2014
>>>>> systemvm64template-4.5-kvm.qcow2
>>>>>
>>>>>
>>>>> I'm not sure if that's relevant, but yesterday, my upgrade from 4.4.3
>>>>> to 4.5.1 is failed when I would re-create a virtual router (using the
>>>>> cloud.com version). I have tried to recreate SSVM and CPVM without
>>>>> success too)
>>>>> (Installation type: Adv Network without SG)
>>>>>
>>>>> I made a re-installation of my test platform with a fresh 4.5.1
>>>>> version with shapeblue version (more recent), failed too on the start=
 of
>>>>> SSVM (blocked on "Cleaning up temporary files..."), after 1 manual VM
>>>>> reset, the SSVM started, but the first VR have the same problem and t=
he
>>>>> reset don't work like the SSVM.
>>>>> (Installation type: Adv Network with SG)
>>>>>
>>>>> I made another re-installation of the test platform with a fresh 4.5.=
1
>>>>> with apt-get.eu version. OK for SSVM but need to do 1 reset for the
>>>>> first VR (and the second VR too).
>>>>> (Installation type: Adv Network without SG)
>>>>>
>>>>>
>>>>> That is relevant?
>>>>>
>>>>> What is the good version?
>>>>>
>>>>> That is a bug for the freeze on "Cleaning up temporary files"?
>>>>>
>>>>> Why the Systemvm checksum is hard-coded in the class? If I had make m=
y
>>>>> upgrade with the shapeblue or apt-get.eu version I think an error
>>>>> will be occur on Upgrade process?
>>>>>
>>>>>
>>>>> Milamber
>>>>>
>>>>> =3D=3D=3D=3D
>>>>> [1]
>>>>> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/e=
n/4.5.1/upgrade/upgrade-4.4.html#update-system-vm-templates
>>>>> [2]
>>>>> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en=
/4.5/management-server/index.html#prepare-the-system-vm-template
>>>>> [3]
>>>>> https://github.com/apache/cloudstack/blob/master/engine/schema/src/co=
m/cloud/upgrade/dao/Upgrade442to450.java#L229
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>  Regards,
>>>> Rohit Yadav
>>>> Software Architect, ShapeBlue
>>>> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
>>>> Blog: bhaisaab.org | Twitter: @_bhaisaab
>>>>
>>>>
>>>>
>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>
>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>> CSForge =E2=80=93 rapid IaaS deployment framework<http://shapeblue.com=
/csforge/
>>>> >
>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>
>>>> This email and any attachments to it may be confidential and are
>>>> intended solely for the use of the individual to whom it is addressed.=
 Any
>>>> views or opinions expressed are solely those of the author and do not
>>>> necessarily represent those of Shape Blue Ltd or related companies. If=
 you
>>>> are not the intended recipient of this email, you must neither take an=
y
>>>> action based upon its contents, nor copy or show it to anyone. Please
>>>> contact the sender if you believe you have received this email in erro=
r.
>>>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>>>> Services India LLP is a company incorporated in India and is operated =
under
>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>>>> company incorporated in Brasil and is operated under license from Shap=
e
>>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic=
 of
>>>> South Africa and is traded under license from Shape Blue Ltd. ShapeBlu=
e is
>>>> a registered trademark.
>>>>
>>>
>>>  Regards,
>> Rohit Yadav
>> Software Architect, ShapeBlue
>> M. +91 88 262 30892 | rohit.yadav@shapeblue.com
>> Blog: bhaisaab.org | Twitter: @_bhaisaab
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related servic=
es
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge =E2=80=93 rapid IaaS deployment framework<http://shapeblue.com/c=
sforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intende=
d
>> solely for the use of the individual to whom it is addressed. Any views =
or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not t=
he
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sen=
der
>> if you believe you have received this email in error. Shape Blue Ltd is =
a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is=
 a
>> company incorporated in India and is operated under license from Shape B=
lue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Bra=
sil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd =
is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>
>
>

--001a113dad8882965d05172c96fc--