cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohit Yadav <>
Subject Re: Using newer DIY SystemVMs
Date Thu, 07 Mar 2013 19:54:08 GMT
On Fri, Mar 8, 2013 at 12:08 AM, Marcus Sorensen <> wrote:
> I see the qcow2 is now compressed, thanks. You can probably skip
> putting it in a bz2 now, it's about the same size.

Had this thought but since we use the cloud-install-sys-tmplt script,
it assumes a qcow2.bz2, see:

We can fix the script, will do that as soon as I get to my keyboard.


> On Thu, Mar 7, 2013 at 10:58 AM, Marcus Sorensen <> wrote:
>> Hmm. I think I was deceived by the /etc/init directory existing.  I'm
>> not sure why it's there, but I don't think the template is using
>> upstart. I'm having a hard time reliably recreating the issue, but I
>> think it's related to other reports where the default gateway is
>> missing (I've seen this myself on a secondary storage VM, but it went
>> away when I rebooted it, and couldn't get the problem to come back).
>> This happens unrelated to any changes I'm making.
>> On Wed, Mar 6, 2013 at 3:54 PM, Marcus Sorensen <> wrote:
>>> After reading a little more about upstart, I don't think this script
>>> does anything. I'm not entirely sure at the moment however how best to
>>> ensure that networking starts after cloud-early-config, short of
>>> converting cloud-early-config to an upstart script. It looks like this
>>> debian build is using upstart just for networking, and everything else
>>> uses the standard sysvinit ordering.
>>> On Wed, Mar 6, 2013 at 2:49 PM, Marcus Sorensen <> wrote:
>>>> Just to be clear, that script may have no effect whatsoever, and I'm
>>>> not sure how to verify other than rebooting a bunch of times. I don't
>>>> have the time to do that at the moment.
>>>> On Wed, Mar 6, 2013 at 2:48 PM, Marcus Sorensen <>
>>>>> There may be one other minor thing that needs to be addressed. In
>>>>> getting rid of the patchdisk, my networking on the router is a bit
>>>>> inconsistent. It looks like maybe networking is starting before
>>>>> cloud-early-config completes, as /etc/network/interfaces looks right,
>>>>> but I don't always get an ip on eth0.
>>>>> I know next to nothing about upstart, and haven't had a chance to test
>>>>> much, so if someone else can help that would be great. I've tried this
>>>>> though and it worked the two times I rebooted, after 70% failures on
>>>>> reboot. It goes it /etc/init/cloud-early-config-wait.conf
>>>>> ----- script start here ----
>>>>> #cloud-early-config-wait
>>>>> start on (starting networking or starting network-interface)
>>>>> instance $JOB
>>>>> script
>>>>>     start cloud-early-config || true
>>>>>     # Waiting forever is ok.. upstart will kill this job when
>>>>>     # the service we tried to start above either starts or stops
>>>>>     while sleep 3600 ; do :; done
>>>>> end script
>>>>> ----script end here---
>>>>> On Wed, Mar 6, 2013 at 9:10 AM, Marcus Sorensen <>
>>>>>> On Wed, Mar 6, 2013 at 2:09 AM, Rohit Yadav <>
>>>>>>> Thanks a lot Marcus, your findings have been useful. I've applied
>>>>>>> locale fix and a grub2 boot timeout fix (systemvms should boot
>>>>>>> seconds faster now).
>>>>>>> Alright so far we're good, tested and systemvm seems to work
on KVM
>>>>>>> (Marcus) and Xen, anyone to help us with VMWare?
>>>>>>> Marcus, about the qemu-ga, we need to patch all our templates
as per
>>>>>>> systemvm type (ssvm, cpvm or rvm), for that we're using the
>>>>>>> systemvm.iso to patch the template appliance and we reboot once
>>>>>>> patching is done successfully in cloud-early-config. So, with
>>>>>>> qemu-ga or our own daemon (assumming through socket we already
>>>>>>> authorized key), do we want to make mgmt server or host copy
>>>>>>> scripts inside the systemvm or just continue using current patching
>>>>>>> mechanism that uses the iso to mount and patch? Marcus can you
>>>>>>> how we can use the new systemvm on devcloud-kvm (osx/vmware-fusion).
>>>>>>> Regards.
>>>>>> I think the systemvm.iso is a completely fine way of getting new
>>>>>> onto the system vms. My main goal at this point was to just get rid
>>>>>> the patch disk portion. Also, since it sounds like we're wanting
>>>>>> move to a link-local API to control the system vms I think we'll
>>>>>> forego qemu-guest-agent or putting our own daemon on the virtio serial
>>>>>> device and simply use it to copy the cmdline/authorized keys.
>>>>>> If this updated system vm checks out, I'll update the devcloud-kvm
>>>>>> packages with it preinstalled, replacing the older one. Or in the
>>>>>> meantime what I've been doing is simply downloading yours and moving
>>>>>> it into place over the existing one, giving it the same name, before
>>>>>> deploying anything.
>>>>>>> On Wed, Mar 6, 2013 at 6:43 AM, Marcus Sorensen <>
>>>>>>>> Oh, and I have yet to test all of the vpc functions, but
so far so
>>>>>>>> good. I was able to bring up the VPC, it got it's gateways
>>>>>>>> configured, and my public ip with portforwarding rule/ acl
to allow 22
>>>>>>>> in worked.
>>>>>>>> On Tue, Mar 5, 2013 at 6:04 PM, Marcus Sorensen <>
>>>>>>>>> Rohit, I think I tracked down why the router keeps rebooting.
When it
>>>>>>>>> comes up, the first thing we do is run,
>>>>>>>>> replies:
>>>>>>>>> /bin/bash: warning: setlocale: LC_ALL: cannot change
locale (en_US.UTF-8)
>>>>>>>>> Cloudstack Release 4.2.0 Tue Mar 5 13:17:51 UTC
>>>>>>>>> 2013&a8af8cdd546e575e64f69b6f80ef949c
>>>>>>>>> Looks like we don't like that locale warning:
>>>>>>>>> GetDomRVersionAnswer":{"result":false,"details":"bash:
>>>>>>>>> setlocale: LC_ALL: cannot change locale (en_US.UTF-8)"
>>>>>>>>> I can fix it by running this in the system vm:
>>>>>>>>> locale-gen en_US.UTF-8
>>>>>>>>> On Tue, Mar 5, 2013 at 10:43 AM, Chiradeep Vittal
>>>>>>>>> <> wrote:
>>>>>>>>>> OK, one more niggle about the previous system vm.
We tried to enable aesni
>>>>>>>>>> [1] to boost encryption performance (ipsec vpn, anything
ssl), but the
>>>>>>>>>> system vm would crash on Vmware if we did that (hence
the module
>>>>>>>>>> blacklisted). Could someone try the new systemvm
on VMWare with aesni
>>>>>>>>>> enabled? I believe it is as simple as
>>>>>>>>>> modprobe aesni_intel and
>>>>>>>>>> openssl 1.0.1
>>>>>>>>>> [1]
>>>>>>>>>> On 3/4/13 10:46 PM, "Rohit Yadav" <>
>>>>>>>>>>>Hi all,
>>>>>>>>>>>Thanks to Mate
>>>>>>>>>>>I'm able to ship appliances that work for Xen.
Chiradeep, there is no
>>>>>>>>>>>need to use the powershell hack now, if people
still want vhdx, they
>>>>>>>>>>>can use that hack. The current appliance for Xen
>>>>>>>>>>>At least appliance for HyperV and Xen works:
>>>>>>>>>>>I've tested and found that:
>>>>>>>>>>>- patching happens
>>>>>>>>>>>- password server works
>>>>>>>>>>>- apache was running, user data works
>>>>>>>>>>>- template creation works
>>>>>>>>>>>- snapshot to template works
>>>>>>>>>>>I won't be able to test VPC/advance zone of DevCloud,
ipv6 etc.
>>>>>>>>>>>someone from QA would have to help.
>>>>>>>>>>>Thanks Marcus for your suggestion, will compress
qcow2 and test on KVM
>>>>>>>>>>>I need help on testing/fixing VMWare systemvm
template appliance.
>>>>>>>>>>>Ahmad :) all natural:
>>>>>>>>>>>PS. Was AFK yesterday, down with flu, much better
>>>>>>>>>>>On Fri, Mar 1, 2013 at 11:29 PM, Chiradeep Vittal
>>>>>>>>>>><> wrote:
>>>>>>>>>>>> On 3/1/13 4:03 AM, "Rohit Yadav" <>
>>>>>>>>>>>>>- Saw systemvms started from the template,
saw patching happening,
>>>>>>>>>>>>>logged in with creds (root/password) to
verify that it was indeed the
>>>>>>>>>>>>>new one (Linux 3.2 :)
>>>>>>>>>>>>>- The agents were running fine, there
was a latency issue (agents were
>>>>>>>>>>>>>lagging behind)
>>>>>>>>>>>>>- (Applied a fix describe on CLOUDSTACK-1370
to make the deployVM
>>>>>>>>>>>>>work) VR came up, did it's SDN magic and
tinyLinux was deployed
>>>>>>>>>>>>>- Console proxy worked for me as well
>>>>>>>>>>>> I would also test
>>>>>>>>>>>>  - password server
>>>>>>>>>>>>  - user data management (is apache web server
>>>>>>>>>>>> In addition
>>>>>>>>>>>>  - zone-to-zone template copy
>>>>>>>>>>>>  - template creation
>>>>>>>>>>>>  - convert snapshot to template
>>>>>>>>>>>>  - vpc
>>>>>>>>>>>>  - ipv6
>>>>>>>>>>>>>Chiradeep, is there a way to convert VHD
(HyperV) to VHD (Xen), I hear
>>>>>>>>>>>>>that they both differ in some magic bits?
>>>>>>>>>>>> Actually since we intend to support Windows
2012, we should be using
>>>>>>>>>>>> There's a way to do it with Powershell (from
vhd(hyper-v) -> vhdx)
>>>>>>>>>>>> to-convert-a-vhd-to-a-vhdx.aspx

View raw message