[Bug 2067924] [NEW] systemd-networkd crashes on systems with amazon-vpc-cni-k8s

Mon Jun 3 15:33:34 UTC 2024

Public bug reported:

On Noble with systemd 255.4-1ubuntu, we're experiencing segfaults on
systems with amazon-vpc-cni-k8s managed interfaces. systemd-networkd
crashes while the CNI interfaces are being configured with the following
stack overflow:

#0  0x00007a362e3c40ba in _hashmap_iterate (h=0x60e89f0a41f8, i=i at entry=0x7fff0a0e6040, value=value at entry=0x7fff0a0e6038, key=key at entry=0x0) at ../src/basic/hashmap.c:722
#1  0x000060e89daaa2b5 in set_iterate (value=0x7fff0a0e6038, i=0x7fff0a0e6040, s=<optimized out>) at ../src/basic/set.h:76
#2  tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:264
#3  0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0c6930) at ../src/network/tc/qdisc.c:301
#4  0x000060e89daaa2ca in tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:268
#5  0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0c6930) at ../src/network/tc/qdisc.c:301

[..]

#87308 0x000060e89daaa2ca in tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:268
#87309 0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0c6930) at ../src/network/tc/qdisc.c:301
#87310 0x000060e89daaa2ca in tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:268
#87311 0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0b51a0) at ../src/network/tc/qdisc.c:301
#87312 0x000060e89da167de in manager_rtnl_process_qdisc (rtnl=<optimized out>, message=0x60e89f0cdf80, m=0x60e89f0a3040) at ../src/network/tc/qdisc.c:549
#87313 0x00007a362e4641fe in process_match (m=0x60e89f0cdf80, nl=0x60e89f0a50c0) at ../src/libsystemd/sd-netlink/sd-netlink.c:314
#87314 process_running (ret=0x0, nl=0x60e89f0a50c0) at ../src/libsystemd/sd-netlink/sd-netlink.c:344
#87315 sd_netlink_process (nl=0x60e89f0a50c0, ret=ret at entry=0x0) at ../src/libsystemd/sd-netlink/sd-netlink.c:374
#87316 0x00007a362e4646d7 in io_callback (s=<optimized out>, fd=<optimized out>, revents=<optimized out>, userdata=<optimized out>) at ../src/libsystemd/sd-netlink/sd-netlink.c:655
#87317 0x00007a362e49c724 in source_dispatch (s=s at entry=0x60e89f0a5240) at ../src/libsystemd/sd-event/sd-event.c:4187
#87318 0x00007a362e49ca6d in sd_event_dispatch (e=<optimized out>, e at entry=0x60e89f0a3380) at ../src/libsystemd/sd-event/sd-event.c:4808
#87319 0x00007a362e49e3d8 in sd_event_run (e=<optimized out>, e at entry=0x60e89f0a3380, timeout=timeout at entry=18446744073709551615) at ../src/libsystemd/sd-event/sd-event.c:4869
#87320 0x00007a362e49e5ff in sd_event_loop (e=<optimized out>) at ../src/libsystemd/sd-event/sd-event.c:4891
#87321 0x000060e89d9e5453 in run (argv=<optimized out>, argc=<optimized out>) at ../src/network/networkd.c:112
#87322 main (argc=<optimized out>, argv=<optimized out>) at ../src/network/networkd.c:119

It appears this issue has been fixed in v256 upstream.

Bug: https://github.com/systemd/systemd/issues/32247
Fixing PR 1: https://github.com/systemd/systemd/commit/632d321050f58fe1b5bed7cfe769d212377c0301
Fixing PR 2: https://github.com/systemd/systemd/commit/ee8f605ded4fea6b93aae018415efae877c26ed2

Would it be possible to backport these fixes to Noble?

** Affects: systemd (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to systemd in Ubuntu.
https://bugs.launchpad.net/bugs/2067924

Title:
  systemd-networkd crashes on systems with amazon-vpc-cni-k8s

Status in systemd package in Ubuntu:
  New

Bug description:
  On Noble with systemd 255.4-1ubuntu, we're experiencing segfaults on
  systems with amazon-vpc-cni-k8s managed interfaces. systemd-networkd
  crashes while the CNI interfaces are being configured with the
  following stack overflow:

  #0  0x00007a362e3c40ba in _hashmap_iterate (h=0x60e89f0a41f8, i=i at entry=0x7fff0a0e6040, value=value at entry=0x7fff0a0e6038, key=key at entry=0x0) at ../src/basic/hashmap.c:722
  #1  0x000060e89daaa2b5 in set_iterate (value=0x7fff0a0e6038, i=0x7fff0a0e6040, s=<optimized out>) at ../src/basic/set.h:76
  #2  tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:264
  #3  0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0c6930) at ../src/network/tc/qdisc.c:301
  #4  0x000060e89daaa2ca in tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:268
  #5  0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0c6930) at ../src/network/tc/qdisc.c:301

  [..]

  #87308 0x000060e89daaa2ca in tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:268
  #87309 0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0c6930) at ../src/network/tc/qdisc.c:301
  #87310 0x000060e89daaa2ca in tclass_drop.isra.0 (tclass=0x60e89f0c5f70) at ../src/network/tc/tclass.c:268
  #87311 0x000060e89daaa18d in qdisc_drop.isra.0 (qdisc=0x60e89f0b51a0) at ../src/network/tc/qdisc.c:301
  #87312 0x000060e89da167de in manager_rtnl_process_qdisc (rtnl=<optimized out>, message=0x60e89f0cdf80, m=0x60e89f0a3040) at ../src/network/tc/qdisc.c:549
  #87313 0x00007a362e4641fe in process_match (m=0x60e89f0cdf80, nl=0x60e89f0a50c0) at ../src/libsystemd/sd-netlink/sd-netlink.c:314
  #87314 process_running (ret=0x0, nl=0x60e89f0a50c0) at ../src/libsystemd/sd-netlink/sd-netlink.c:344
  #87315 sd_netlink_process (nl=0x60e89f0a50c0, ret=ret at entry=0x0) at ../src/libsystemd/sd-netlink/sd-netlink.c:374
  #87316 0x00007a362e4646d7 in io_callback (s=<optimized out>, fd=<optimized out>, revents=<optimized out>, userdata=<optimized out>) at ../src/libsystemd/sd-netlink/sd-netlink.c:655
  #87317 0x00007a362e49c724 in source_dispatch (s=s at entry=0x60e89f0a5240) at ../src/libsystemd/sd-event/sd-event.c:4187
  #87318 0x00007a362e49ca6d in sd_event_dispatch (e=<optimized out>, e at entry=0x60e89f0a3380) at ../src/libsystemd/sd-event/sd-event.c:4808
  #87319 0x00007a362e49e3d8 in sd_event_run (e=<optimized out>, e at entry=0x60e89f0a3380, timeout=timeout at entry=18446744073709551615) at ../src/libsystemd/sd-event/sd-event.c:4869
  #87320 0x00007a362e49e5ff in sd_event_loop (e=<optimized out>) at ../src/libsystemd/sd-event/sd-event.c:4891
  #87321 0x000060e89d9e5453 in run (argv=<optimized out>, argc=<optimized out>) at ../src/network/networkd.c:112
  #87322 main (argc=<optimized out>, argv=<optimized out>) at ../src/network/networkd.c:119

  It appears this issue has been fixed in v256 upstream.

  Bug: https://github.com/systemd/systemd/issues/32247
  Fixing PR 1: https://github.com/systemd/systemd/commit/632d321050f58fe1b5bed7cfe769d212377c0301
  Fixing PR 2: https://github.com/systemd/systemd/commit/ee8f605ded4fea6b93aae018415efae877c26ed2

  Would it be possible to backport these fixes to Noble?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/2067924/+subscriptions