[Bug 2036358] Re: systemd wait-online now times out after jammy and lunar upgrade

[Nick Rosbrook]

I believe the remaining autopkgtest failures are unrelated.

For lunar[1], we have ubuntu-drivers-common failing on ppc64el[2]. We
can see the same failure on a different test run without a systemd
trigger[3].

For jammy[4], we have  linux-nvidia[5] and linux-nvidia-tegra-igx[6],
each failing their "rebuild" test. This happens frequently and is
unrelated to the systemd change. Finally, there is netplan.io failing
its "tunnels" test[7]. This is failing without systemd triggers too[8],
and I checked with @danilogondolfo to confirm that this is a separate
issue.

[1] https://ubuntu-archive-team.ubuntu.com/proposed-migration/lunar/update_excuses.html#systemd
[2] https://autopkgtest.ubuntu.com/results/autopkgtest-lunar/lunar/ppc64el/u/ubuntu-drivers-common/20230925_224541_eee1a@/log.gz
[3] https://autopkgtest.ubuntu.com/results/autopkgtest-lunar/lunar/ppc64el/u/ubuntu-drivers-common/20230815_053853_379e2@/log.gz
[4] https://ubuntu-archive-team.ubuntu.com/proposed-migration/jammy/update_excuses.html#systemd
[5] https://autopkgtest.ubuntu.com/results/autopkgtest-jammy/jammy/amd64/l/linux-nvidia-6.2/20230926_000856_1a567@/log.gz
[6] https://autopkgtest.ubuntu.com/results/autopkgtest-jammy/jammy/arm64/l/linux-nvidia-tegra-igx/20230926_010738_40534@/log.gz
[7] https://autopkgtest.ubuntu.com/results/autopkgtest-jammy/jammy/amd64/n/netplan.io/20230925_232048_829bd@/log.gz
[8] https://autopkgtest.ubuntu.com/results/autopkgtest-jammy/jammy/amd64/n/netplan.io/20230907_195833_5846d@/log.gz

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to systemd in Ubuntu.
https://bugs.launchpad.net/bugs/2036358

Title:
  systemd wait-online now times out after jammy and lunar upgrade

Status in systemd package in Ubuntu:
  Invalid
Status in systemd source package in Jammy:
  Fix Committed
Status in systemd source package in Lunar:
  Fix Committed

Bug description:
  [NOTE]

  If you are running a desktop system and you see this issue, you should
  run:

  $ systemctl disable --now systemd-networkd.service

  This will disable systemd-networkd and associated units, including
  systemd-networkd-wait-online.service. NetworkManager and systemd-
  networkd should not be running at the same time. On desktop,
  NetworkManager is the default network stack.

  [Impact]

  When all interfaces are "not required for online", e.g. when they are
  marked "optional: true" in netplan, systemd-networkd-wait-online will
  timeout. Or, in other words, systemd-networkd-wait-online will timeout
  even though all interfaces are ignored, hence none of them will ever
  be marked as "ready." Depending on what units depend on network-
  online.target, this can delay boot by 120 seconds (the default timeout
  for systemd-networkd-wait-online).

  [Test Plan]

  1. Create a new LXD container. These instructions assume jammy is the
  release, but the same can be done for lunar.

  $ lxc launch ubuntu-daily:jammy jammy
  $ lxc exec jammy bash

  2. Once in the container, modify the default /etc/netplan/10-lxc.yaml
  so that eth0 is configured with "optional: true":

  $ vi /etc/netplan/50-cloud-init.yaml # Use whatever editor you like
  $ cat /etc/netplan/50-cloud-init.yaml
  network:
    version: 2
    ethernets:
      eth0:
        dhcp4: true
        dhcp-identifier: mac
        optional: true

  3. Re-generate and apply the netplan configuration.

  $ netplan generate
  $ netplan apply

  4. Manually run systemd-networkd-wait-online, and observe that all
  links are ignored, and the command times out:

  $ SYSTEMD_LOG_LEVEL=debug /lib/systemd/systemd-networkd-wait-online --timeout=10
  Found link lo(1)
  Found link eth0(19)
  lo: link is ignored
  eth0: link is ignored
  Timeout occurred while waiting for network connectivity.

  [Where problems could occur]

  This patch partially re-instates a patch remove in bug 1982218.
  However, instead of exiting if all links are unmanaged, we exit if all
  links are ignored in manager_configured(). If the patch was wrong, we
  may re-introduce bug 1982218, so as part of this SRU verification,
  that bug should be tested too. Any other regressions would also be
  related to systemd-networkd-wait-online behavior.

  [Original Description]

  On Ubuntu 22.04 desktop system using network-manager and upgrading to
  systemd 249.11-0ubuntu3.10, wait-online now times out which prevents
  logins (GDM, ssh, console) until it does time out. This seems to be
  introduced by the change for
  https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1982218.

  https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1982218/comments/21
  also mentioned the problem on Lunar.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/2036358/+subscriptions