| 1 |
Dear, |
| 2 |
|
| 3 |
I've attempted to upgrade a Xen box from 3.1.2 to 3.2.1. Unfortunately |
| 4 |
it has been a partial success only. At this point I'm really stuck |
| 5 |
with a network problem that affects my HVM machines (Linux PV run |
| 6 |
fine). |
| 7 |
|
| 8 |
The really odd thing is that everything seems to work properly, except |
| 9 |
that the "vif" network interfaces in dom0 seem to have only dropped TX |
| 10 |
packets for the HVM domains and 0 RX packets. It seems like something |
| 11 |
is broken in the network communication path between the HVM domain and |
| 12 |
dom0. |
| 13 |
|
| 14 |
A second change I made was to use Gentoo for configuration of the |
| 15 |
bridge device, rather than the network-bridge script. I did this |
| 16 |
already for some other bridges, but these don't have any HVM domains |
| 17 |
connected. |
| 18 |
|
| 19 |
Also, ipvs (linux virtual server) doesn't seem to work. Although I |
| 20 |
cannot yet claim this is caused by the upgrade, it seems likely. Xen was |
| 21 |
te only change made before I broke that functionality. |
| 22 |
Every configuration, I expect you should know is, I hope, included below: |
| 23 |
|
| 24 |
Anyone know/guessing what's going wrong? |
| 25 |
Is there any known problem? |
| 26 |
How can I solve this? |
| 27 |
How can I diagnose this? |
| 28 |
|
| 29 |
Unfortunally I need my services and I restored my previous backup, so I |
| 30 |
don't really have a box handy any more to try out these things. |
| 31 |
|
| 32 |
- Joris |
| 33 |
|
| 34 |
=== |
| 35 |
|
| 36 |
*Configuration* |
| 37 |
|
| 38 |
Hardware |
| 39 |
Intel Core 2 Duo E6750 2.66 GHz (clocked at 2.0 GHz) |
| 40 |
Intel PRO/1000 NIC (eth0) |
| 41 |
Realtek RTL8168b/8111b (eth1) |
| 42 |
|
| 43 |
Hypervisor: |
| 44 |
Gentoo 2007, Xen 3.2.1. 64-bit |
| 45 |
(XEN) Xen version 3.2.1 (root@×××××××.local) (gcc version 3.4.6 |
| 46 |
(Gentoo Hardened 3.4.6-r2 p1.5, ssp-3.4.6-1.0, pie-8.7.10)) Sun Jun 15 |
| 47 |
19:54:30 CEST 2008 |
| 48 |
|
| 49 |
Dom0: |
| 50 |
Gentoo 2007 Linux. 64-bit |
| 51 |
Linux version 2.6.20-xen-r6 (root@susa) (gcc version 3.4.6 (Gentoo |
| 52 |
Hardened 3.4.6-r2 p1.5, ssp-3.4.6-1.0, pie-8.7.10)) #15 SMP Tue Jan 22 |
| 53 |
17:12:46 CET 2008 |
| 54 |
(This version was working perfectly in combination with Xen 3.1.2) |
| 55 |
|
| 56 |
DomU (HVM): |
| 57 |
Windows Server 2003 SP2, 32-bit |
| 58 |
Ubuntu 6.06 LTS Dapper Drake, 32-bit |
| 59 |
|
| 60 |
=== |
| 61 |
|
| 62 |
*Dom0 ifconfig (portions only)* |
| 63 |
|
| 64 |
Please notice the "TX dropped!" |
| 65 |
eth0 Link encap:Ethernet HWaddr 00:1B:21:05:02:77 |
| 66 |
UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 |
| 67 |
RX packets:58606 errors:0 dropped:0 overruns:0 frame:0 |
| 68 |
TX packets:97615 errors:0 dropped:0 overruns:0 carrier:0 |
| 69 |
collisions:0 txqueuelen:1000 |
| 70 |
RX bytes:5015772 (4.7 Mb) TX bytes:43265853 (41.2 Mb) |
| 71 |
Base address:0xb000 Memory:f1020000-f1040000 |
| 72 |
-- |
| 73 |
eth1 Link encap:Ethernet HWaddr 00:1A:4D:50:02:9C |
| 74 |
UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 |
| 75 |
RX packets:979621 errors:0 dropped:0 overruns:0 frame:0 |
| 76 |
TX packets:967219 errors:0 dropped:0 overruns:0 carrier:0 |
| 77 |
collisions:0 txqueuelen:1000 |
| 78 |
RX bytes:300713690 (286.7 Mb) TX bytes:292573959 (279.0 Mb) |
| 79 |
Interrupt:16 Base address:0x6000 |
| 80 |
-- |
| 81 |
vif16.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF |
| 82 |
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 |
| 83 |
RX packets:0 errors:0 dropped:0 overruns:0 frame:0 |
| 84 |
TX packets:0 errors:0 dropped:11676 overruns:0 carrier:0 |
| 85 |
collisions:0 txqueuelen:32 |
| 86 |
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) |
| 87 |
|
| 88 |
-- |
| 89 |
vif18.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF |
| 90 |
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 |
| 91 |
RX packets:0 errors:0 dropped:0 overruns:0 frame:0 |
| 92 |
TX packets:0 errors:0 dropped:11617 overruns:0 carrier:0 |
| 93 |
collisions:0 txqueuelen:32 |
| 94 |
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) |
| 95 |
|
| 96 |
vif19.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF |
| 97 |
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 |
| 98 |
RX packets:0 errors:0 dropped:0 overruns:0 frame:0 |
| 99 |
TX packets:0 errors:0 dropped:11600 overruns:0 carrier:0 |
| 100 |
collisions:0 txqueuelen:32 |
| 101 |
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) |
| 102 |
|
| 103 |
-- |
| 104 |
vif21.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF |
| 105 |
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 |
| 106 |
RX packets:0 errors:0 dropped:0 overruns:0 frame:0 |
| 107 |
TX packets:0 errors:0 dropped:11428 overruns:0 carrier:0 |
| 108 |
collisions:0 txqueuelen:32 |
| 109 |
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) |
| 110 |
-- |
| 111 |
xenbr0 Link encap:Ethernet HWaddr 00:1B:21:05:02:77 |
| 112 |
inet addr:192.168.10.32 Bcast:192.168.10.255 Mask:255.255.255.0 |
| 113 |
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 |
| 114 |
RX packets:77866 errors:0 dropped:0 overruns:0 frame:0 |
| 115 |
TX packets:67193 errors:0 dropped:0 overruns:0 carrier:0 |
| 116 |
collisions:0 txqueuelen:0 |
| 117 |
RX bytes:8868267 (8.4 Mb) TX bytes:35487507 (33.8 Mb) |
| 118 |
|
| 119 |
xenbr1 Link encap:Ethernet HWaddr 00:1A:4D:50:02:9C |
| 120 |
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 |
| 121 |
RX packets:213 errors:0 dropped:0 overruns:0 frame:0 |
| 122 |
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 |
| 123 |
collisions:0 txqueuelen:0 |
| 124 |
RX bytes:9700 (9.4 Kb) TX bytes:0 (0.0 b) |
| 125 |
|
| 126 |
xenbr2 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF |
| 127 |
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 |
| 128 |
RX packets:2 errors:0 dropped:0 overruns:0 frame:0 |
| 129 |
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 |
| 130 |
collisions:0 txqueuelen:0 |
| 131 |
RX bytes:56 (56.0 b) TX bytes:0 (0.0 b) |
| 132 |
|
| 133 |
=== |
| 134 |
|
| 135 |
*Configuration files:* |
| 136 |
# -*- mode: python; -*- |
| 137 |
import os, re |
| 138 |
arch = os.uname()[4] |
| 139 |
if re.search('64', arch): |
| 140 |
arch_libdir = 'lib64' |
| 141 |
else: |
| 142 |
arch_libdir = 'lib' |
| 143 |
kernel = "/usr/lib/xen/boot/hvmloader" |
| 144 |
builder='hvm' |
| 145 |
memory = 512 |
| 146 |
name = "shushan" |
| 147 |
vcpus=1 |
| 148 |
pae=1 |
| 149 |
acpi=1 |
| 150 |
apic=1 |
| 151 |
vif = [ 'type=ioemu, mac=02:60:68:e5:e4:a5, bridge=xenbr0' ] |
| 152 |
disk = [ 'phy:/dev/vg_raid_continues/shushan_primary,ioemu:hda,w' ] |
| 153 |
device_model = '/usr/' + arch_libdir + '/xen/bin/qemu-dm' |
| 154 |
boot="cd" |
| 155 |
sdl=0 |
| 156 |
vnc=1 |
| 157 |
vncdisplay=99 |
| 158 |
vncunused=0 |
| 159 |
stdvga=0 |
| 160 |
serial='pty' |
| 161 |
|
| 162 |
(Other HVM are just variations on this script, with only the obvious |
| 163 |
parameters different (memory, name, vcups, vif[mac], disk[location], |
| 164 |
vncdisplay). |
| 165 |
|
| 166 |
=== |
| 167 |
|
| 168 |
*brctl show* |
| 169 |
bridge name bridge id STP enabled interfaces |
| 170 |
xenbr0 8000.001b21050277 no eth0 |
| 171 |
vif13.0 |
| 172 |
vif14.0 |
| 173 |
vif15.0 |
| 174 |
vif16.0 |
| 175 |
vif17.0 |
| 176 |
vif18.0 |
| 177 |
vif19.0 |
| 178 |
vif20.0 |
| 179 |
vif21.0 |
| 180 |
vif22.0 |
| 181 |
vif23.0 |
| 182 |
vif24.0 |
| 183 |
xenbr1 8000.001a4d50029c no eth1 |
| 184 |
vif14.2 |
| 185 |
xenbr2 8000.feffffffffff no vif14.1 |
| 186 |
|
| 187 |
This looks very OK. |
| 188 |
|
| 189 |
=== |
| 190 |
|
| 191 |
*/etc/conf.d/net (Gentoo)* |
| 192 |
modules=( "iproute2" ) |
| 193 |
dns_domain=( "joris2k.local" ) |
| 194 |
dns_domain_lo=( "joris2k.local" ) |
| 195 |
dns_domain_eth0=( "joris2k.local" ) |
| 196 |
dns_domain_eth1=( "joris2k.local" ) |
| 197 |
dns_servers=( "192.168.10.a 192.168.10.b 192.168.10.c" ) |
| 198 |
dns_servers_eth0=( "192.168.10.a 192.168.10.b 192.168.10.c" ) |
| 199 |
dns_servers_eth1=( "192.168.10.a 192.168.10.b 192.168.10.c" ) |
| 200 |
config_eth0=("null") |
| 201 |
bridge_xenbr0=("eth0") |
| 202 |
brctl_xenbr0=("setfd 0" "sethello 0" "stp off") |
| 203 |
config_xenbr0=( "192.168.10.d netmask 255.255.255.0" ) |
| 204 |
routes_xenbr0=( "default via 192.168.10.e" ) |
| 205 |
depend_xenbr0() { |
| 206 |
need net.eth0 |
| 207 |
} |
| 208 |
config_eth1=( "null" ) |
| 209 |
brctl_xenbr1=("setfd 0" "sethello 0" "stp off") |
| 210 |
bridge_xenbr1=("eth1") |
| 211 |
config_xenbr1=("null") |
| 212 |
depend_xenbr1() { |
| 213 |
need net.eth1 |
| 214 |
} |
| 215 |
brctl_xenbr2=("setfd 0" "sethello 0" "stp off") |
| 216 |
config_xenbr2=( "null" ) |
| 217 |
|
| 218 |
|
| 219 |
-- |
| 220 |
gentoo-user@l.g.o mailing list |
Archives