[Bug 2085157] [NEW] mkinitramfs fails with copy_file binary '/libgcc_s.so.[1-9]' not found

[Frank Heimes]

Public bug reported:

I recently did an 24.10 install (on s390x, but I think this doesn't
matter) and was surprised that the system hangs during the post-install
reboot.

Investigation showed that this happens if the installer applies updates,
which is done by default, if there is proper network connectivity and
archive access.

In case of an install where I disabled the network, hence an offline
install was done, the installation incl. post-install reboot was
successful.

So I took such a successfully installed system (where no updates were applied) and noticed that currently the available updates are:
$ apt list --upgradable
iproute2/oracular-updates 6.10.0-2ubuntu1 s390x [upgradable from: 6.10.0-2]
linux-generic/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
linux-headers-generic/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
linux-image-generic/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
linux-libc-dev/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
linux-tools-common/oracular-updates 6.11.0-9.9 all [upgradable from: 6.11.0-8.8]

So seemed to be kernel related, hence tried to update the kernel manually:
$ sudo apt install linux-image-generic/oracular-updates
Selected version '6.11.0-9.9' (Ubuntu:24.10/oracular-updates [s390x]) for 'linux-image-generic'
Upgrading:
  linux-generic          linux-image-generic  linux-tools-common
  linux-headers-generic  linux-libc-dev

Installing dependencies:
  linux-headers-6.11.0-9          linux-modules-extra-6.11.0-9-generic
  linux-headers-6.11.0-9-generic  linux-tools-6.11.0-9
  linux-image-6.11.0-9-generic    linux-tools-6.11.0-9-generic
  linux-modules-6.11.0-9-generic

Suggested packages:
  fdutils  linux-tools

Summary:
  Upgrading: 5, Installing: 7, Removing: 0, Not Upgrading: 1
  Download size: 65.3 MB
  Space needed: 165 MB / 21.2 GB available
  └─ in /boot:  43.1 MB / 1,876 MB available

Continue? [Y/n] Y
...
Setting up linux-generic (6.11.0-9.9) ...
Progress: [ 96%] [███████████████████████████████████████████████████████▋  ] 
Progress: [ 96%] [███████████████████████████████████████████████████████▋  ] 
Progress: [ 96%] [███████████████████████████████████████████████████████▋  ] 
update-initramfs: Generating /boot/initrd.img-6.11.0-9-generic
mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found█████▋  ] 
mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found
Using config file '/etc/zipl.conf'
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Building bootmap in '/boot'
Adding IPL section 'ubuntu' (default)
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Preparing boot device for LD-IPL: dm-0.
Done.
/etc/kernel/postinst.d/kdump-tools:
kdump-tools: Generating /var/lib/kdump/initrd.img-6.11.0-9-generic
mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found
mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found
/etc/kernel/postinst.d/zz-zipl:
Using config file '/etc/zipl.conf'
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Building bootmap in '/boot'
Adding IPL section 'ubuntu' (default)
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Preparing boot device for LD-IPL: dm-0.
Done.
Scanning processes...                                                           
Scanning processor microcode...                                                 
Scanning linux images...                                                        

Pending kernel upgrade!
Running kernel version:
  6.11.0-8-generic
Diagnostics:
  The currently running kernel version is not the expected kernel version
6.11.0-9-generic.

Restarting the system to load the new kernel will not be handled automatically,
so you should consider rebooting.

Failed to check for processor microcode upgrades.

No services need to be restarted.

No containers need to be restarted.

No user sessions are running outdated binaries.

No VM guests are running outdated hypervisor (qemu) binaries on this
host.

I noticed these two lines, that have been spit out by update-initramfs:
update-initramfs: Generating /boot/initrd.img-6.11.0-9-generic
mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found█████▋  ] 
mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found

Hence I tried to ran update-initramfs on the release kernel 6.11.0-8-8
and it happened there as well:

$ sudo update-initramfs -k all -u
update-initramfs: Generating /boot/initrd.img-6.11.0-8-generic
mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found
mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found
Using config file '/etc/zipl.conf'
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Building bootmap in '/boot'
Adding IPL section 'ubuntu' (default)
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Run /lib/s390-tools/zipl_helper.device-mapper 252:1
Preparing boot device for LD-IPL: dm-0.
Done.

So it's a initramfs-tools (mkinitramfs) issue rather than a kernel issue,
somewhere in copy_libgcc() (or before).

Seems to be a small issue, but is causing a big impact, since it leads
to a broken default installation.

** Affects: initramfs-tools (Ubuntu)
     Importance: Critical
         Status: New


** Tags: rls-oo-incoming

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to initramfs-tools in Ubuntu.
https://bugs.launchpad.net/bugs/2085157

Title:
  mkinitramfs fails with copy_file binary '/libgcc_s.so.[1-9]' not found

Status in initramfs-tools package in Ubuntu:
  New

Bug description:
  I recently did an 24.10 install (on s390x, but I think this doesn't
  matter) and was surprised that the system hangs during the post-
  install reboot.

  Investigation showed that this happens if the installer applies
  updates, which is done by default, if there is proper network
  connectivity and archive access.

  In case of an install where I disabled the network, hence an offline
  install was done, the installation incl. post-install reboot was
  successful.

  So I took such a successfully installed system (where no updates were applied) and noticed that currently the available updates are:
  $ apt list --upgradable
  iproute2/oracular-updates 6.10.0-2ubuntu1 s390x [upgradable from: 6.10.0-2]
  linux-generic/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
  linux-headers-generic/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
  linux-image-generic/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
  linux-libc-dev/oracular-updates 6.11.0-9.9 s390x [upgradable from: 6.11.0-8.8]
  linux-tools-common/oracular-updates 6.11.0-9.9 all [upgradable from: 6.11.0-8.8]

  So seemed to be kernel related, hence tried to update the kernel manually:
  $ sudo apt install linux-image-generic/oracular-updates
  Selected version '6.11.0-9.9' (Ubuntu:24.10/oracular-updates [s390x]) for 'linux-image-generic'
  Upgrading:
    linux-generic          linux-image-generic  linux-tools-common
    linux-headers-generic  linux-libc-dev

  Installing dependencies:
    linux-headers-6.11.0-9          linux-modules-extra-6.11.0-9-generic
    linux-headers-6.11.0-9-generic  linux-tools-6.11.0-9
    linux-image-6.11.0-9-generic    linux-tools-6.11.0-9-generic
    linux-modules-6.11.0-9-generic

  Suggested packages:
    fdutils  linux-tools

  Summary:
    Upgrading: 5, Installing: 7, Removing: 0, Not Upgrading: 1
    Download size: 65.3 MB
    Space needed: 165 MB / 21.2 GB available
    └─ in /boot:  43.1 MB / 1,876 MB available

  Continue? [Y/n] Y
  ...
  Setting up linux-generic (6.11.0-9.9) ...
  Progress: [ 96%] [███████████████████████████████████████████████████████▋  ] 
  Progress: [ 96%] [███████████████████████████████████████████████████████▋  ] 
  Progress: [ 96%] [███████████████████████████████████████████████████████▋  ] 
  update-initramfs: Generating /boot/initrd.img-6.11.0-9-generic
  mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found█████▋  ] 
  mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found
  Using config file '/etc/zipl.conf'
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Building bootmap in '/boot'
  Adding IPL section 'ubuntu' (default)
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Preparing boot device for LD-IPL: dm-0.
  Done.
  /etc/kernel/postinst.d/kdump-tools:
  kdump-tools: Generating /var/lib/kdump/initrd.img-6.11.0-9-generic
  mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found
  mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found
  /etc/kernel/postinst.d/zz-zipl:
  Using config file '/etc/zipl.conf'
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Building bootmap in '/boot'
  Adding IPL section 'ubuntu' (default)
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Preparing boot device for LD-IPL: dm-0.
  Done.
  Scanning processes...                                                           
  Scanning processor microcode...                                                 
  Scanning linux images...                                                        

  Pending kernel upgrade!
  Running kernel version:
    6.11.0-8-generic
  Diagnostics:
    The currently running kernel version is not the expected kernel version
  6.11.0-9-generic.

  Restarting the system to load the new kernel will not be handled automatically,
  so you should consider rebooting.

  Failed to check for processor microcode upgrades.

  No services need to be restarted.

  No containers need to be restarted.

  No user sessions are running outdated binaries.

  No VM guests are running outdated hypervisor (qemu) binaries on this
  host.

  I noticed these two lines, that have been spit out by update-initramfs:
  update-initramfs: Generating /boot/initrd.img-6.11.0-9-generic
  mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found█████▋  ] 
  mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found

  Hence I tried to ran update-initramfs on the release kernel 6.11.0-8-8
  and it happened there as well:

  $ sudo update-initramfs -k all -u
  update-initramfs: Generating /boot/initrd.img-6.11.0-8-generic
  mkinitramfs: copy_file: binary '/usr/lib/udev/dmsetup_env' not found
  mkinitramfs: copy_file: binary '/libgcc_s.so.[1-9]' not found
  Using config file '/etc/zipl.conf'
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Building bootmap in '/boot'
  Adding IPL section 'ubuntu' (default)
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Run /lib/s390-tools/zipl_helper.device-mapper 252:1
  Preparing boot device for LD-IPL: dm-0.
  Done.

  So it's a initramfs-tools (mkinitramfs) issue rather than a kernel issue,
  somewhere in copy_libgcc() (or before).

  Seems to be a small issue, but is causing a big impact, since it leads
  to a broken default installation.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/2085157/+subscriptions