Return-Path: X-Original-To: apmail-cloudstack-dev-archive@www.apache.org Delivered-To: apmail-cloudstack-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A683617903 for ; Wed, 18 Feb 2015 07:38:39 +0000 (UTC) Received: (qmail 76876 invoked by uid 500); 18 Feb 2015 07:38:39 -0000 Delivered-To: apmail-cloudstack-dev-archive@cloudstack.apache.org Received: (qmail 76826 invoked by uid 500); 18 Feb 2015 07:38:39 -0000 Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list dev@cloudstack.apache.org Received: (qmail 76814 invoked by uid 99); 18 Feb 2015 07:38:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Feb 2015 07:38:39 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of daan.hoogland@gmail.com designates 209.85.213.46 as permitted sender) Received: from [209.85.213.46] (HELO mail-yh0-f46.google.com) (209.85.213.46) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Feb 2015 07:38:13 +0000 Received: by yhl29 with SMTP id 29so1799330yhl.0 for ; Tue, 17 Feb 2015 23:37:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; bh=AMWccCX5otxLqosMsOkdI5BpaU4wlTfF8S/hpP8EL34=; b=sy/mnyurD2eZE08npEmYHcOTR1iNP+xjVvrO2zUUQdulzTPbw9zWgOEBPqKTdgIvaD +Q3CSCsyxenNXipFoIYILdElrABkm17TW6khqDzkh2s+u2gT1yfeXyeF8SJrNmggdmpr r5AjiID9HtXZJKsnNdRwOMlUJdrBhi5EzjJpKaBytQble9uPyqO2qJwl312T3BjarjI7 OiVZNBzvlRPM28deHiFAjrazyF60PNJ+Z1D01hPrIsOfNkuGLLBg7mCIAdaq1II6gUui xov7dsM+DqJTutYgm70JUBwtkq/xE5d4jMR5O4czupa6a5waagTlNCPgIJeNDyFxbVdm ArQA== X-Received: by 10.170.185.6 with SMTP id b6mr1288524yke.25.1424245046722; Tue, 17 Feb 2015 23:37:26 -0800 (PST) MIME-Version: 1.0 Received: by 10.170.113.17 with HTTP; Tue, 17 Feb 2015 23:37:06 -0800 (PST) In-Reply-To: References: <1EB47CDB-21D2-4D4C-9A3B-0C32F6094BE3@schubergphilis.com> <4F32CC4A-5AA9-4B23-BF7B-BBB551C737F0@schubergphilis.com> From: Daan Hoogland Date: Wed, 18 Feb 2015 07:37:06 +0000 Message-ID: Subject: Re: [MERGE] Redundant VPC routers and persistent router config To: dev Cc: John Kinsella , int-cloud , Ian Southam Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Good point Marcus. I'll look into that. On Tue, Feb 17, 2015 at 9:38 PM, Marcus wrote: > Yes, I just want to make sure that it doesn't require/assume > persistency when some people rely on recreate.systemvm.enabled=3Dtrue to > provide clean/fresh systemvms with every reboot, consistent with the > cloud paradigm. > > On Tue, Feb 17, 2015 at 12:09 PM, Daan Hoogland = wrote: >> Yes, the delete works. Dont know if we included the option recreate in >> our tests. Should not be a biggy though. It is not relevant for the >> persistency. >> >> On Tue, Feb 17, 2015 at 8:05 PM, Marcus wrote: >>> But a recreate will still work, right? If you delete the router or set >>> recreate.systemvm.enabled=3Dtrue it will still result in a working >>> router? >>> >>> On Tue, Feb 17, 2015 at 11:05 AM, Daan Hoogland wrote: >>>> It means that cloudstack doesn't have to reconfigure them on reboot as >>>> they have the config on disk. >>>> >>>> On Tue, Feb 17, 2015 at 4:16 PM, Marcus wrote: >>>>> Can someone expand on what's meant by 'systemvm persistent config'? >>>>> Somehow this makes me think that the systemvms would no longer be >>>>> easily rebuildable. >>>>> >>>>> On Tue, Feb 17, 2015 at 5:11 AM, Wilder Rodrigues >>>>> wrote: >>>>>> Hi there, >>>>>> >>>>>> I=E2=80=99m building a devcloud-kvm in order to test our changes wit= h a different environment as well. >>>>>> >>>>>> Cheers, >>>>>> Wilder >>>>>> >>>>>> >>>>>> On 17 Feb 2015, at 01:46, Wilder Rodrigues wrote: >>>>>> >>>>>>> Hi all, >>>>>>> >>>>>>> I have been some tests on the branch in order to give you all some = confidence. >>>>>>> >>>>>>> During the tests I found 1 bug related to communication from VM A o= n Tier 1 to VM B on Tier 2 in a Single VPC. I can reproduce the bug and it = disappears when I convert the Single VPC to a redundant one. I already talk= ed to Ian and he is on it. >>>>>>> >>>>>>> Results follow below. >>>>>>> >>>>>>> Cheers, >>>>>>> Wilder >>>>>>> >>>>>>> Environment: >>>>>>> >>>>>>> Xen 6.2 running on VMware zone within our Betacloud (ACS 4.4.2) >>>>>>> MySQL running on MacBook Pro >>>>>>> Management Server on MacBook Pro >>>>>>> >>>>>>> ::: Manual Tests::: >>>>>>> >>>>>>> Isolated Networks >>>>>>> >>>>>>> * Create Network >>>>>>> * Create 2 VMs using new Network >>>>>>> * Create FW rules >>>>>>> * Create PF rules >>>>>>> * SSH to the VMs >>>>>>> * SSH from one VM onto the other in the same isolated network >>>>>>> * Destroy Master router >>>>>>> * Restart the Network >>>>>>> * Restart the Network with Clean-up option >>>>>>> * Repeat steps above >>>>>>> >>>>>>> Redundant Isolated Networks >>>>>>> >>>>>>> * Create Redundant Network Offering >>>>>>> * Create 2 VMs using new offering >>>>>>> * Create FW rules >>>>>>> * Create PF rules >>>>>>> * SSH to the VMs >>>>>>> * SSH from one VM onto the other in the same redundant isolated net= work >>>>>>> * Destroy Master router >>>>>>> * Restart the Network >>>>>>> * Stop the Master Router >>>>>>> >>>>>>> Single VPC >>>>>>> >>>>>>> * Create VPC >>>>>>> * Create 2 Tiers >>>>>>> * Create ACLS >>>>>>> * Create 1 Vm for each Tier >>>>>>> * Associate 2 IP address >>>>>>> * Add PF rules >>>>>>> * SSH onto VMs >>>>>>> * SSH from 1 VM onto another >>>>>>> * Restart VPC - Make it redundant >>>>>>> * Repeat steps above >>>>>>> >>>>>>> Redundant VPC >>>>>>> >>>>>>> * Create VPC >>>>>>> * Create 2 Tiers >>>>>>> * Create ACLS >>>>>>> * Create 1 Vm for each Tier >>>>>>> * Associate 2 IP address >>>>>>> * Add PF rules >>>>>>> * SSH onto VMs >>>>>>> * SSH from 1 VM onto another >>>>>>> * Stop/Destroy the Master Router >>>>>>> * Observe the Backup router became Master >>>>>>> * SSH again onto the VMs >>>>>>> * Restart VPC (without clean-up) >>>>>>> * Observer only 1 new router is created >>>>>>> * New router is started as Backup >>>>>>> * SSH onto VMs >>>>>>> * Restart VPC (with clean-up) >>>>>>> * Observer only 2 new routers are created >>>>>>> * SSH onto VMs >>>>>>> >>>>>>> ::: Automated Tests ::: >>>>>>> >>>>>>> Test Create Account and user for that account ... =3D=3D=3D TestNam= e: test_01_create_account | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test Sub domain allowed to launch VM when a Domain level zone is c= reated ... =3D=3D=3D TestName: test_01_add_vm_to_subdomain | Status : SUCCE= SS =3D=3D=3D >>>>>>> ok >>>>>>> Test delete domain without force option ... =3D=3D=3D TestName: tes= t_DeleteDomain | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test delete domain with force option ... =3D=3D=3D TestName: test_f= orceDeleteDomain | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test update admin details ... =3D=3D=3D TestName: test_updateAdminD= etails | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test update domain admin details ... =3D=3D=3D TestName: test_updat= eDomainAdminDetails | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test user update API ... =3D=3D=3D TestName: test_updateUserDetails= | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test login API with domain ... =3D=3D=3D TestName: test_LoginApiDom= ain | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test if Login API does not return UUID's ... =3D=3D=3D TestName: te= st_LoginApiUuidResponse | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 9 tests in 1140.977s >>>>>>> >>>>>>> OK >>>>>>> >>>>>>> Test reset virtual machine on reboot ... =3D=3D=3D TestName: test_0= 1_reset_vm_on_reboot | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 1 test in 216.907s >>>>>>> >>>>>>> OK >>>>>>> >>>>>>> Test advanced zone virtual router ... =3D=3D=3D TestName: test_advZ= oneVirtualRouter | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test Deploy Virtual Machine ... =3D=3D=3D TestName: test_deploy_vm = | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test Multiple Deploy Virtual Machine ... =3D=3D=3D TestName: test_d= eploy_vm_multiple | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test Stop Virtual Machine ... =3D=3D=3D TestName: test_01_stop_vm |= Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test Start Virtual Machine ... =3D=3D=3D TestName: test_02_start_vm= | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test Reboot Virtual Machine ... =3D=3D=3D TestName: test_03_reboot_= vm | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test destroy Virtual Machine ... =3D=3D=3D TestName: test_06_destro= y_vm | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test recover Virtual Machine ... =3D=3D=3D TestName: test_07_restor= e_vm | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test migrate VM ... SKIP: At least two hosts should be present in t= he zone for migration >>>>>>> Test destroy(expunge) Virtual Machine ... =3D=3D=3D TestName: test_= 09_expunge_vm | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 10 tests in 851.022s >>>>>>> >>>>>>> OK (SKIP=3D1) >>>>>>> >>>>>>> Test router internal advanced zone ... SKIP: Marvin configuration h= as no host credentials to check router services >>>>>>> Test restart network ... =3D=3D=3D TestName: test_03_restart_networ= k_cleanup | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test router basic setup ... =3D=3D=3D TestName: test_05_router_basi= c | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test router advanced setup ... =3D=3D=3D TestName: test_06_router_a= dvanced | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test stop router ... =3D=3D=3D TestName: test_07_stop_router | Stat= us : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test start router ... =3D=3D=3D TestName: test_08_start_router | St= atus : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test reboot router ... =3D=3D=3D TestName: test_09_reboot_router | = Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 7 tests in 454.519s >>>>>>> >>>>>>> OK (SKIP=3D1) >>>>>>> >>>>>>> Test to create service offering ... =3D=3D=3D TestName: test_01_cre= ate_service_offering | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test to update existing service offering ... =3D=3D=3D TestName: te= st_02_edit_service_offering | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test to delete service offering ... =3D=3D=3D TestName: test_03_del= ete_service_offering | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 3 tests in 206.916s >>>>>>> >>>>>>> OK >>>>>>> >>>>>>> Test VPN in VPC ... =3D=3D=3D TestName: test_vpc_remote_access_vpn = | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test VPN in VPC ... =3D=3D=3D TestName: test_vpc_site2site_vpn | St= atus : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 2 tests in 373.908s >>>>>>> >>>>>>> OK >>>>>>> >>>>>>> Test create VPC offering ... =3D=3D=3D TestName: test_01_create_vpc= _offering | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test VPC offering without load balancing service ... =3D=3D=3D Test= Name: test_03_vpc_off_without_lb | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test VPC offering without static NAT service ... =3D=3D=3D TestName= : test_04_vpc_off_without_static_nat | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test VPC offering without port forwarding service ... =3D=3D=3D Tes= tName: test_05_vpc_off_without_pf | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test VPC offering with invalid services ... =3D=3D=3D TestName: tes= t_06_vpc_off_invalid_services | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test update VPC offering ... =3D=3D=3D TestName: test_07_update_vpc= _off | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test list VPC offering ... =3D=3D=3D TestName: test_08_list_vpc_off= | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> test_09_create_redundant_vpc_offering (integration.acs.tests.test_v= pc_offerings.TestVPCOffering) ... =3D=3D=3D TestName: test_09_create_redund= ant_vpc_offering | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 8 tests in 672.382s >>>>>>> >>>>>>> OK >>>>>>> >>>>>>> test_privategw_acl (integration.acs.tests.test_privategw_acl.TestPr= ivateGwACL) ... =3D=3D=3D TestName: test_privategw_acl | Status : SUCCESS = =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 1 test in 90.756s >>>>>>> >>>>>>> OK >>>>>>> >>>>>>> Test to change service offering of router after addition of one gue= st network ... =3D=3D=3D TestName: test_04_chg_srv_off_router_after_additio= n_of_one_guest_network | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test destroy of router after addition of one guest network ... =3D= =3D=3D TestName: test_05_destroy_router_after_addition_of_one_guest_network= | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test to stop and start router after creation of VPC ... =3D=3D=3D T= estName: test_01_stop_start_router_after_creating_vpc | Status : SUCCESS = =3D=3D=3D >>>>>>> ok >>>>>>> Test to reboot the router after creating a VPC ... =3D=3D=3D TestNa= me: test_02_reboot_router_after_creating_vpc | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Tests to change service offering of the Router after ... =3D=3D=3D = TestName: test_04_change_service_offerring_vpc | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> Test to destroy the router after creating a VPC ... =3D=3D=3D TestN= ame: test_05_destroy_router_after_creating_vpc | Status : SUCCESS =3D=3D=3D >>>>>>> ok >>>>>>> >>>>>>> -------------------------------------------------------------------= --- >>>>>>> Ran 6 tests in 665.965s >>>>>>> >>>>>>> OK >>>>>>> >>>>>>> On 16 Feb 2015, at 17:53, Daan Hoogland w= rote: >>>>>>> >>>>>>>> H, >>>>>>>> >>>>>>>> I will merge our feature/systemvm-persistent-config into master. I= f >>>>>>>> you have objections please let me know before tomorrow. >>>>>>>> >>>>>>>> @john: your comment was addressed in the present day version. >>>>>>>> >>>>>>>> -- >>>>>>>> Daan >>>>>>> >>>>>> >>>> >>>> >>>> >>>> -- >>>> Daan >> >> >> >> -- >> Daan --=20 Daan