cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcus Sorensen <>
Subject Re: Using newer DIY SystemVMs
Date Thu, 07 Mar 2013 20:07:26 GMT
Ok, didn't realize we were going to point people to this particular
system vm for production installs, I thought this was just a
proof-of-concept for building custom ones.

On Thu, Mar 7, 2013 at 12:54 PM, Rohit Yadav <> wrote:
> On Fri, Mar 8, 2013 at 12:08 AM, Marcus Sorensen <> wrote:
>> I see the qcow2 is now compressed, thanks. You can probably skip
>> putting it in a bz2 now, it's about the same size.
> Had this thought but since we use the cloud-install-sys-tmplt script,
> it assumes a qcow2.bz2, see:
> We can fix the script, will do that as soon as I get to my keyboard.
> Regards.
>> On Thu, Mar 7, 2013 at 10:58 AM, Marcus Sorensen <> wrote:
>>> Hmm. I think I was deceived by the /etc/init directory existing.  I'm
>>> not sure why it's there, but I don't think the template is using
>>> upstart. I'm having a hard time reliably recreating the issue, but I
>>> think it's related to other reports where the default gateway is
>>> missing (I've seen this myself on a secondary storage VM, but it went
>>> away when I rebooted it, and couldn't get the problem to come back).
>>> This happens unrelated to any changes I'm making.
>>> On Wed, Mar 6, 2013 at 3:54 PM, Marcus Sorensen <> wrote:
>>>> After reading a little more about upstart, I don't think this script
>>>> does anything. I'm not entirely sure at the moment however how best to
>>>> ensure that networking starts after cloud-early-config, short of
>>>> converting cloud-early-config to an upstart script. It looks like this
>>>> debian build is using upstart just for networking, and everything else
>>>> uses the standard sysvinit ordering.
>>>> On Wed, Mar 6, 2013 at 2:49 PM, Marcus Sorensen <>
>>>>> Just to be clear, that script may have no effect whatsoever, and I'm
>>>>> not sure how to verify other than rebooting a bunch of times. I don't
>>>>> have the time to do that at the moment.
>>>>> On Wed, Mar 6, 2013 at 2:48 PM, Marcus Sorensen <>
>>>>>> There may be one other minor thing that needs to be addressed. In
>>>>>> getting rid of the patchdisk, my networking on the router is a bit
>>>>>> inconsistent. It looks like maybe networking is starting before
>>>>>> cloud-early-config completes, as /etc/network/interfaces looks right,
>>>>>> but I don't always get an ip on eth0.
>>>>>> I know next to nothing about upstart, and haven't had a chance to
>>>>>> much, so if someone else can help that would be great. I've tried
>>>>>> though and it worked the two times I rebooted, after 70% failures
>>>>>> reboot. It goes it /etc/init/cloud-early-config-wait.conf
>>>>>> ----- script start here ----
>>>>>> #cloud-early-config-wait
>>>>>> start on (starting networking or starting network-interface)
>>>>>> instance $JOB
>>>>>> script
>>>>>>     start cloud-early-config || true
>>>>>>     # Waiting forever is ok.. upstart will kill this job when
>>>>>>     # the service we tried to start above either starts or stops
>>>>>>     while sleep 3600 ; do :; done
>>>>>> end script
>>>>>> ----script end here---
>>>>>> On Wed, Mar 6, 2013 at 9:10 AM, Marcus Sorensen <>
>>>>>>> On Wed, Mar 6, 2013 at 2:09 AM, Rohit Yadav <>
>>>>>>>> Thanks a lot Marcus, your findings have been useful. I've
applied the
>>>>>>>> locale fix and a grub2 boot timeout fix (systemvms should
boot 5
>>>>>>>> seconds faster now).
>>>>>>>> Alright so far we're good, tested and systemvm seems to work
on KVM
>>>>>>>> (Marcus) and Xen, anyone to help us with VMWare?
>>>>>>>> Marcus, about the qemu-ga, we need to patch all our templates
as per
>>>>>>>> systemvm type (ssvm, cpvm or rvm), for that we're using the
>>>>>>>> systemvm.iso to patch the template appliance and we reboot
>>>>>>>> patching is done successfully in cloud-early-config. So,
with using
>>>>>>>> qemu-ga or our own daemon (assumming through socket we already
>>>>>>>> authorized key), do we want to make mgmt server or host copy
>>>>>>>> scripts inside the systemvm or just continue using current
>>>>>>>> mechanism that uses the iso to mount and patch? Marcus can
you share
>>>>>>>> how we can use the new systemvm on devcloud-kvm (osx/vmware-fusion).
>>>>>>>> Regards.
>>>>>>> I think the systemvm.iso is a completely fine way of getting
new code
>>>>>>> onto the system vms. My main goal at this point was to just get
rid of
>>>>>>> the patch disk portion. Also, since it sounds like we're wanting
>>>>>>> move to a link-local API to control the system vms I think we'll
>>>>>>> forego qemu-guest-agent or putting our own daemon on the virtio
>>>>>>> device and simply use it to copy the cmdline/authorized keys.
>>>>>>> If this updated system vm checks out, I'll update the devcloud-kvm
>>>>>>> packages with it preinstalled, replacing the older one. Or in
>>>>>>> meantime what I've been doing is simply downloading yours and
>>>>>>> it into place over the existing one, giving it the same name,
>>>>>>> deploying anything.
>>>>>>>> On Wed, Mar 6, 2013 at 6:43 AM, Marcus Sorensen <>
>>>>>>>>> Oh, and I have yet to test all of the vpc functions,
but so far so
>>>>>>>>> good. I was able to bring up the VPC, it got it's gateways
>>>>>>>>> configured, and my public ip with portforwarding rule/
acl to allow 22
>>>>>>>>> in worked.
>>>>>>>>> On Tue, Mar 5, 2013 at 6:04 PM, Marcus Sorensen <>
>>>>>>>>>> Rohit, I think I tracked down why the router keeps
rebooting. When it
>>>>>>>>>> comes up, the first thing we do is run,
>>>>>>>>>> replies:
>>>>>>>>>> /bin/bash: warning: setlocale: LC_ALL: cannot change
locale (en_US.UTF-8)
>>>>>>>>>> Cloudstack Release 4.2.0 Tue Mar 5 13:17:51 UTC
>>>>>>>>>> 2013&a8af8cdd546e575e64f69b6f80ef949c
>>>>>>>>>> Looks like we don't like that locale warning:
>>>>>>>>>> GetDomRVersionAnswer":{"result":false,"details":"bash:
>>>>>>>>>> setlocale: LC_ALL: cannot change locale (en_US.UTF-8)"
>>>>>>>>>> I can fix it by running this in the system vm:
>>>>>>>>>> locale-gen en_US.UTF-8
>>>>>>>>>> On Tue, Mar 5, 2013 at 10:43 AM, Chiradeep Vittal
>>>>>>>>>> <> wrote:
>>>>>>>>>>> OK, one more niggle about the previous system
vm. We tried to enable aesni
>>>>>>>>>>> [1] to boost encryption performance (ipsec vpn,
anything ssl), but the
>>>>>>>>>>> system vm would crash on Vmware if we did that
(hence the module
>>>>>>>>>>> blacklisted). Could someone try the new systemvm
on VMWare with aesni
>>>>>>>>>>> enabled? I believe it is as simple as
>>>>>>>>>>> modprobe aesni_intel and
>>>>>>>>>>> openssl 1.0.1
>>>>>>>>>>> [1]
>>>>>>>>>>> On 3/4/13 10:46 PM, "Rohit Yadav" <>
>>>>>>>>>>>>Hi all,
>>>>>>>>>>>>Thanks to Mate
>>>>>>>>>>>>I'm able to ship appliances that work for
Xen. Chiradeep, there is no
>>>>>>>>>>>>need to use the powershell hack now, if people
still want vhdx, they
>>>>>>>>>>>>can use that hack. The current appliance for
Xen (vbox->raw->vhd)
>>>>>>>>>>>>At least appliance for HyperV and Xen works:
>>>>>>>>>>>>I've tested and found that:
>>>>>>>>>>>>- patching happens
>>>>>>>>>>>>- password server works
>>>>>>>>>>>>- apache was running, user data works
>>>>>>>>>>>>- template creation works
>>>>>>>>>>>>- snapshot to template works
>>>>>>>>>>>>I won't be able to test VPC/advance zone of
DevCloud, ipv6 etc.
>>>>>>>>>>>>someone from QA would have to help.
>>>>>>>>>>>>Thanks Marcus for your suggestion, will compress
qcow2 and test on KVM
>>>>>>>>>>>>I need help on testing/fixing VMWare systemvm
template appliance.
>>>>>>>>>>>>Ahmad :) all natural:
>>>>>>>>>>>>PS. Was AFK yesterday, down with flu, much
better now.
>>>>>>>>>>>>On Fri, Mar 1, 2013 at 11:29 PM, Chiradeep
>>>>>>>>>>>><> wrote:
>>>>>>>>>>>>> On 3/1/13 4:03 AM, "Rohit Yadav" <>
>>>>>>>>>>>>>>- Saw systemvms started from the template,
saw patching happening,
>>>>>>>>>>>>>>logged in with creds (root/password)
to verify that it was indeed the
>>>>>>>>>>>>>>new one (Linux 3.2 :)
>>>>>>>>>>>>>>- The agents were running fine, there
was a latency issue (agents were
>>>>>>>>>>>>>>lagging behind)
>>>>>>>>>>>>>>- (Applied a fix describe on CLOUDSTACK-1370
to make the deployVM
>>>>>>>>>>>>>>work) VR came up, did it's SDN magic
and tinyLinux was deployed
>>>>>>>>>>>>>>- Console proxy worked for me as well
>>>>>>>>>>>>> I would also test
>>>>>>>>>>>>>  - password server
>>>>>>>>>>>>>  - user data management (is apache web
server running?)
>>>>>>>>>>>>> In addition
>>>>>>>>>>>>>  - zone-to-zone template copy
>>>>>>>>>>>>>  - template creation
>>>>>>>>>>>>>  - convert snapshot to template
>>>>>>>>>>>>>  - vpc
>>>>>>>>>>>>>  - ipv6
>>>>>>>>>>>>>>Chiradeep, is there a way to convert
VHD (HyperV) to VHD (Xen), I hear
>>>>>>>>>>>>>>that they both differ in some magic
>>>>>>>>>>>>> Actually since we intend to support Windows
2012, we should be using
>>>>>>>>>>>>> There's a way to do it with Powershell
(from vhd(hyper-v) -> vhdx)
>>>>>>>>>>>>> to-convert-a-vhd-to-a-vhdx.aspx

View raw message