[wicked-devel] ifup on macvlan does not start underlying device

30 Dec 2013

      Hi list

The following might be a non-issue, but I would still like to mention my observations. The reason being that my customer is mainly managing their complex network setup through their own management tools.

In testing a macvlan on top of a bond it appears that manually starting the macvlan interface with 
# wicked ifup macvlan0
does not start the underlying device, it is associated to.

When starting the bond device itself, that one starts its slaves correctly as per below :

os131b:/etc/wicked/ifconfig # cat ens7.xml
<interface>
  <name>ens7</name>
  <control>
    <link-detection>
      <timeout>10</timeout>
      <require-link/>
    </link-detection>
  </control>
  <link/>
</interface>

os131b:/etc/wicked/ifconfig # cat ens8.xml
<interface>
  <name>ens8</name>
  <control>
    <link-detection>
      <timeout>10</timeout>
      <require-link/>
    </link-detection>
  </control>
  <link/>
</interface>

os131b:/etc/wicked/ifconfig # cat bond0.xml
<interface>
  <name>bond0</name>
  <control>
    <link-detection>
      <timeout>10</timeout>
      <require-link/>
    </link-detection>
  </control>
  <bond>
    <mode>active-backup</mode>
    <miimon>
      <frequency>100</frequency>
      <carrier>netif</carrier>
    </miimon>
    <slaves>
      <slave>
        <device>ens7</device>
      </slave>
      <slave>
        <device>ens8</device>
      </slave>
    </slaves>
  </bond>
  <link/>
</interface>

os131b:/etc/wicked/ifconfig # ip l sh
1: lo:  mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: ens7:  mtu 1500 qdisc pfifo_fast state DOWN mode DEFAULT qlen 1000
    link/ether 52:54:00:f0:33:4b brd ff:ff:ff:ff:ff:ff
3: ens8:  mtu 1500 qdisc pfifo_fast state DOWN mode DEFAULT qlen 1000
    link/ether 52:54:00:d7:b9:8e brd ff:ff:ff:ff:ff:ff
4: eth2:  mtu 1500 qdisc pfifo_fast state UP mode DEFAULT qlen 1000
    link/ether 52:54:00:93:d2:81 brd ff:ff:ff:ff:ff:ff

os131b:/etc/wicked/ifconfig # wicked ifup bond0
bond0: network-up

os131b:/etc/wicked/ifconfig # ip l sh
1: lo:  mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: ens7:  mtu 1500 qdisc pfifo_fast master bond0 state UP mode DEFAULT qlen 1000
    link/ether 52:54:00:f0:33:4b brd ff:ff:ff:ff:ff:ff
3: ens8:  mtu 1500 qdisc pfifo_fast master bond0 state UP mode DEFAULT qlen 1000
    link/ether 52:54:00:f0:33:4b brd ff:ff:ff:ff:ff:ff
4: eth2:  mtu 1500 qdisc pfifo_fast state UP mode DEFAULT qlen 1000
    link/ether 52:54:00:93:d2:81 brd ff:ff:ff:ff:ff:ff
15: bond0:  mtu 1500 qdisc noqueue state UP mode DEFAULT 
    link/ether 52:54:00:f0:33:4b brd ff:ff:ff:ff:ff:ff

os131b:/etc/wicked/ifconfig # wicked ifdown bond0
bond0: device-down

os131b:/etc/wicked/ifconfig # cat macvlan0.xml
<interface>
  <name>macvlan0</name>
  ipv4:static
    <address>
      <local>172.10.31.4/24</local>
    </address>

  <macvlan>
    <device>bond0</device>
    <mode>bridge</mode>
  </macvlan>
</interface>
os131b:/etc/wicked/ifconfig # wicked ifup macvlan0
bond0: device-exists
wicked: device macvlan0 failed: operation timed out
wicked: device bond0 failed: operation timed out

os131b:/etc/wicked/ifconfig # ip l sh
1: lo:  mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: ens7:  mtu 1500 qdisc pfifo_fast state UP mode DEFAULT qlen 1000
    link/ether 52:54:00:f0:33:4b brd ff:ff:ff:ff:ff:ff
3: ens8:  mtu 1500 qdisc pfifo_fast state DOWN mode DEFAULT qlen 1000
    link/ether 52:54:00:d7:b9:8e brd ff:ff:ff:ff:ff:ff
4: eth0:  mtu 1500 qdisc pfifo_fast state UP mode DEFAULT qlen 1000
    link/ether 52:54:00:93:d2:81 brd ff:ff:ff:ff:ff:ff
9: bond0:  mtu 1500 qdisc noop state DOWN mode DEFAULT 
    link/ether 76:9a:17:18:79:c3 brd ff:ff:ff:ff:ff:ff
10: macvlan0@bond0:  mtu 1500 qdisc noqueue state LOWERLAYERDOWN mode DEFAULT 
    link/ether 76:9a:17:18:79:c3 brd ff:ff:ff:ff:ff:ff

This also happens if the underlying macvlan device is a regular interface, e.g. ens7 in the above setup.
If the underlying device is started before trying to start the macvlan device, it works.

Again, when booting the system, the devices are brought up correctly. However post-boot interface management must also work for wicked to be useful to my customer, who is managing interfaces in their SLES based telco systems. They have up to thousands of virtual interfaces defined on a single machine.

Researching this I have noticed some syslog messages that appear when down'ing virtual interfaces. 
Perhaps they can give some hints :

2013-12-30T14:42:35.947330+01:00 linux-vr36 wickedd-dhcp6[592]: unable to open /sys/class/net/bond0/bonding/slaves: No such file or directory
2013-12-30T14:42:35.947644+01:00 linux-vr36 wickedd-dhcp6[592]: bond0: cannot get bonding attribute mode
2013-12-30T14:42:35.948150+01:00 linux-vr36 wickedd-dhcp6[592]: error retrieving bonding attribute from sysfs
2013-12-30T14:42:35.960640+01:00 linux-vr36 wickedd[562]: unable to open /sys/class/net/bond0/bonding/slaves: No such file or directory
2013-12-30T14:42:35.961549+01:00 linux-vr36 wickedd[562]: bond0: cannot get bonding attribute mode
2013-12-30T14:42:35.962277+01:00 linux-vr36 wickedd[562]: error retrieving bonding attribute from sysfs
...
...
...
2013-12-30T14:42:35.968078+01:00 linux-vr36 wickedd[562]: cannot send device-delete event for model "bond0" - no dbus device
<<<
2013-12-30T14:43:19.379833+01:00 linux-vr36 kernel: [ 9433.464445] bonding: bond0 is being created...
2013-12-30T14:43:19.435791+01:00 linux-vr36 kernel: [ 9433.520436] device bond0 entered promiscuous mode
2013-12-30T14:43:19.435808+01:00 linux-vr36 kernel: [ 9433.520525] IPv6: ADDRCONF(NETDEV_UP): macvlan0: link is not ready
2013-12-30T14:43:19.435501+01:00 linux-vr36 wickedd-dhcp4[595]: macvlan0: reconfig changes device type! d6 l0
2013-12-30T14:43:39.398381+01:00 linux-vr36 wicked: device macvlan0 failed: operation timed out
2013-12-30T14:43:39.399146+01:00 linux-vr36 wicked: device bond0 failed: operation timed out
2013-12-30T14:44:45.178972+01:00 linux-vr36 kernel: [ 9519.263529] device bond0 left promiscuous mode
2013-12-30T14:44:45.220664+01:00 linux-vr36 avahi-daemon[555]: Withdrawing workstation service for macvlan0.
...
2013-12-30T14:44:45.238129+01:00 linux-vr36 wickedd[562]: cannot send device-delete event for model "macvlan0" - no dbus device
<<<
Please let me know if this kind of issues are considered spamming of the mailing list.

Thanks.

Best regards
Andreas Taschner
Dedicated Support Engineer
SUSE
-- 
To unsubscribe, e-mail: wicked-devel+unsubscribe@opensuse.org
To contact the owner, e-mail: wicked-devel+owner@opensuse.org

Andreas Taschner

Marius Tomaschewski

tags

participants (2)