cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian Smith <bmsmit...@gmail.com>
Subject New Setup, CloudStack 4.8 - Networking Problems
Date Sat, 30 Apr 2016 19:44:37 GMT
Hello,

I am new to ACS and just deployed a proof of concept environment. My goal
is to run in Advanced Network configuration.

So far, I have 2 servers which have 2 NICs each. 1 server is a management
and the other is a KVM hypervisor

What I am experiencing:

I can ping the Management Server and the KVM Host without any issue. I can
also ping to the two System VMs (Console and Secondary Storage VM) on the,
what I call Internal network. (10.32.0.0/24).

I cannot ping the Public IP for the System VMs and therefore, it won't
download templates, etc.

I am connecting this all to a Cisco 6509 Switch

Important VLANs:
VLAN 80 - 10.32.0.0/24 All Hypervisors, management and storage nodes live
here
VLAN 81 - 104.x.x.128/27 This is going to be the public IPs for the system
VMs.

On the KVM Hypervisor, eth0 is connected to Gi4/39 and eth1 is connected to
Gi3/3 on the switch.

##SWITCH CONFIGURATION
#show run int gi4/39
interface GigabitEthernet4/39
 description mgmt01.cs -eth0
 switchport
 switchport trunk native vlan 80
 switchport trunk allowed vlan 80
 switchport mode trunk
end

#show run int gi3/3
interface GigabitEthernet3/3
 description mgmt01.cs -eth0
 switchport
 switchport trunk native vlan 81
 switchport trunk allowed vlan 80,81
 switchport mode trunk
end

$$node01 - KVM HOST NETWORK CONFIGURATION

[root@node01 ~]# ifconfig
breth1-81 Link encap:Ethernet  HWaddr 00:23:8B:CE:5E:C6
          inet6 addr: fe80::223:8bff:fece:5ec6/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:22 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:616 (616.0 b)  TX bytes:468 (468.0 b)

cloud0    Link encap:Ethernet  HWaddr FE:00:A9:FE:00:48
          inet addr:169.254.0.1  Bcast:0.0.0.0  Mask:255.255.0.0
          inet6 addr: fe80::6c50:45ff:fe33:a6e8/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:289 errors:0 dropped:0 overruns:0 frame:0
          TX packets:413 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:29487 (28.7 KiB)  TX bytes:29895 (29.1 KiB)

cloudbr0  Link encap:Ethernet  HWaddr 00:23:8B:CE:5E:C5
          inet addr:10.32.0.98  Bcast:10.32.0.255  Mask:255.255.255.0
          inet6 addr: fe80::223:8bff:fece:5ec5/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:54188 errors:0 dropped:0 overruns:0 frame:0
          TX packets:59313 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:216790382 (206.7 MiB)  TX bytes:181559895 (173.1 MiB)

cloudbr1  Link encap:Ethernet  HWaddr 00:23:8B:CE:5E:C6
          inet6 addr: fe80::223:8bff:fece:5ec6/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:56636 errors:0 dropped:0 overruns:0 frame:0
          TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:3383292 (3.2 MiB)  TX bytes:578 (578.0 b)

eth0.80   Link encap:Ethernet  HWaddr 00:23:8B:CE:5E:C5
          inet6 addr: fe80::223:8bff:fece:5ec5/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:171389 errors:0 dropped:0 overruns:0 frame:0
          TX packets:176284 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:226117957 (215.6 MiB)  TX bytes:190098763 (181.2 MiB)
          Interrupt:20 Memory:df5c0000-df5e0000

eth1      Link encap:Ethernet  HWaddr 00:23:8B:CE:5E:C6
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:57894 errors:0 dropped:0 overruns:0 frame:0
          TX packets:49 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:4748864 (4.5 MiB)  TX bytes:3726 (3.6 KiB)
          Interrupt:16 Memory:df6e0000-df700000

eth1.81   Link encap:Ethernet  HWaddr 00:23:8B:CE:5E:C6
          inet6 addr: fe80::223:8bff:fece:5ec6/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:34 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:1860 (1.8 KiB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:13 errors:0 dropped:0 overruns:0 frame:0
          TX packets:13 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1144 (1.1 KiB)  TX bytes:1144 (1.1 KiB)

virbr0    Link encap:Ethernet  HWaddr 52:54:00:D7:F9:D6
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vnet0     Link encap:Ethernet  HWaddr FE:00:A9:FE:00:48
          inet6 addr: fe80::fc00:a9ff:fefe:48/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:278 errors:0 dropped:0 overruns:0 frame:0
          TX packets:401 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:32861 (32.0 KiB)  TX bytes:29159 (28.4 KiB)

vnet1     Link encap:Ethernet  HWaddr FE:1F:96:00:00:01
          inet6 addr: fe80::fc1f:96ff:fe00:1/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1653 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1958 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:142088 (138.7 KiB)  TX bytes:207540 (202.6 KiB)

vnet2     Link encap:Ethernet  HWaddr FE:C0:EE:00:00:08
          inet6 addr: fe80::fcc0:eeff:fe00:8/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:17 errors:0 dropped:0 overruns:0 frame:0
          TX packets:19 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:762 (762.0 b)  TX bytes:1230 (1.2 KiB)

vnet3     Link encap:Ethernet  HWaddr FE:00:A9:FE:03:42
          inet6 addr: fe80::fc00:a9ff:fefe:342/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:11 errors:0 dropped:0 overruns:0 frame:0
          TX packets:45 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:672 (672.0 b)  TX bytes:2430 (2.3 KiB)

vnet4     Link encap:Ethernet  HWaddr FE:5D:7C:00:00:05
          inet6 addr: fe80::fc5d:7cff:fe00:5/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:962 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1261 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:139736 (136.4 KiB)  TX bytes:253449 (247.5 KiB)

vnet5     Link encap:Ethernet  HWaddr FE:46:D2:00:00:07
          inet6 addr: fe80::fc46:d2ff:fe00:7/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:8 errors:0 dropped:0 overruns:0 frame:0
          TX packets:27 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:384 (384.0 b)  TX bytes:1530 (1.4 KiB)

vnet6     Link encap:Ethernet  HWaddr FE:7A:72:00:00:19
          inet6 addr: fe80::fc7a:72ff:fe00:19/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:8 errors:0 dropped:0 overruns:0 frame:0
          TX packets:601 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:624 (624.0 b)  TX bytes:90661 (88.5 KiB)

## ifcfg-eth0.80
DEVICE=eth0.80
TYPE=Ethernet
HWADDR=00:23:8B:CE:5E:C5
TYPE=Ethernet
UUID=a2f0a042-3d0f-4325-ab13-c9ed60cb9a3e
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
BRIDGE=cloudbr0
DNS1=8.8.8.8

## ifcfg-eth1.81
DEVICE=eth1
HWADDR=00:23:8B:CE:5E:C6
TYPE=Ethernet
UUID=367654c0-d0c5-4bed-8191-d3f65c8a315f
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
BRIDGE=cloudbr1

## ifcfg-cloudbr0
DEVICE=cloudbr0
TYPE=Bridge
ONBOOT=yes
BOOTPROTO=none
IPADDR=10.32.0.98
NETMASK=255.255.255.0
GATEWAY=10.32.0.2
DELAY=0
STP=no
DNS1=8.8.8.8

## ifcfg-cloudbr1
DEVICE=cloudbr1
TYPE=Bridge
ONBOOT=yes
BOOTPROTO=none
STP=no
DELAY=0


Screenshots:

Home > Infrastructure > Zones >Zone1 > Physical Network -
http://prntscr.com/aysnia
Home > Infrastructure > Zones >Zone1 > Physical Network 1
http://prntscr.com/aysnta
Home > Infrastructure > Zones >Zone1 > Physical Network 1  > Management >
Details  http://prntscr.com/ayso8d
Home > Infrastructure > Zones >Zone1 > Physical Network 1  > Management >IP
Ranges http://prntscr.com/aysol9
  Note: Storage config for Physical Network 1 looks the same (cloudbr0 as
well)

Home > Infrastructure > Zones >Zone1 > Physical Network 2
http://prntscr.com/aysp50
Home > Infrastructure > Zones >Zone1 > Physical Network 2 > Guest > Details
 http://prntscr.com/ayspic
  Note: Nothing under "Network" or "Dedicated VLAN/VNI Ranges" tabs.

Home > Infrastructure > Zones >Zone1 > Physical Network 2 > Public >
Details  http://prntscr.com/aysq5o
Home > Infrastructure > Zones >Zone1 > Physical Network 2 > Public > IP
Ranges >  <http://prntscr.com/aysqz3>http://prntscr.com/aysqz3

System VMs:

s-1-vm - Secondary Storage VM
Public IP: 104.x.x.130
Private IP: 10.32.0.9
Screenshot: http://prntscr.com/ayss7l

v-2-VM - Console VM
Public IP: 104.x.x.131
Private IP: 10.32.0.5
Screenshot: http://prntscr.com/ayst0y

When I SSH'd into the VM (v-2-VM) to run the check script here is the
outpout:

root@v-2-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh
================================================
First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 48 data bytes
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 0 packets received, 100% packet loss
WARNING: cannot ping DNS server
route follows
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use
Iface
0.0.0.0         104.x.x.129 0.0.0.0         UG    0      0        0 eth2
8.8.8.8         10.32.0.2       255.255.255.255 UGH   0      0        0 eth1
10.0.0.0        10.32.0.2       255.0.0.0       UG    0      0        0 eth1
10.32.0.0       0.0.0.0         255.255.255.0   U     0      0        0 eth1
104.x.x.128 0.0.0.0         255.255.255.224 U     0      0        0 eth2
169.254.0.0     0.0.0.0         255.255.0.0     U     0      0        0 eth0
172.16.0.0      10.32.0.2       255.240.0.0     UG    0      0        0 eth1
192.168.0.0     10.32.0.2       255.255.0.0     UG    0      0        0 eth1
================================================
ERROR: DNS not resolving download.cloud.com
resolv.conf follows
nameserver 8.8.8.8
nameserver 8.8.8.8
root@v-2-VM:~# ping 10.32.0.97
PING 10.32.0.97 (10.32.0.97): 48 data bytes
56 bytes from 10.32.0.97: icmp_seq=0 ttl=64 time=0.249 ms

10.32.0.97 is the management server

What portion of my configuration appears to be wrong?

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message