[Bug 1874272] Re: Stage "searching for obsolete software" takes a very long time (30 minutes)

Thu Aug 22 08:20:56 UTC 2024

Hello Jean-Baptiste, or anyone else affected,

Accepted ubuntu-release-upgrader into noble-proposed. The package will
build now and be available at
https://launchpad.net/ubuntu/+source/ubuntu-release-upgrader/1:24.04.22
in a few hours, and then in the -proposed repository.

Please help us by testing this new package.  See
https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how
to enable and use -proposed.  Your feedback will aid us getting this
update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested, what testing has been
performed on the package and change the tag from verification-needed-
noble to verification-done-noble. If it does not fix the bug for you,
please add a comment stating that, and change the tag to verification-
failed-noble. In either case, without details of your testing we will
not be able to proceed.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification .  Thank you in
advance for helping!

N.B. The updated package will be released to -updates after the bug(s)
fixed by this package have been verified and the package has been in
-proposed for a minimum of 7 days.

** Tags removed: verification-done verification-done-noble
** Tags added: verification-needed verification-needed-noble

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1874272

Title:
  Stage "searching for obsolete software" takes a very long time (30
  minutes)

Status in ubuntu-release-upgrader package in Ubuntu:
  Fix Released
Status in ubuntu-release-upgrader source package in Focal:
  Won't Fix
Status in ubuntu-release-upgrader source package in Noble:
  Fix Committed

Bug description:
  [Impact]
  Upgrades hang for a long time searching for obsolete software, frustrating users.

  [Test plan]

  1. With each, update, and proposed version do:

    0. launch a container / VM
    1. do-release-upgrade
    2. Note down the time it took for the obsolete software stage, and the packages marked for removal.

  2. Check that the time is now significantly smaller than before

  For example with the default ubuntu:jammy lxd container:

  before: ~8s
  2024-07-16 15:13:25,575 DEBUG Start checking for obsolete pkgs
  2024-07-16 15:13:33,847 DEBUG Finish checking for obsolete pkgs

  after: ~0.5s
  2024-07-16 15:22:21,977 DEBUG Start checking for obsolete pkgs
  2024-07-16 15:22:22,508 DEBUG Finish checking for obsolete pkgs

  3. Compare the list of packages marked for removal: It should be the
  same or more packages.

  before:
  2024-07-16 15:13:33,907 DEBUG The following packages are marked for removal: libperl5.34 python3.10 libctf-nobfd0 libblockdev-part2 libblockdev-swap2 libpcre3 libunistring2 libaio1 libmpdec3 libbinutils python3-jeepney libpython3.10-minimal libblockdev-fs2 libpython3.10-stdlib binuti
  ls-x86-64-linux-gnu irqbalance libbpf0 libtss2-mu0 libldap-2.5-0 isc-dhcp-common libisc-export1105 libappstream4 libpython3.10 libblockdev-loop2 libblockdev2 libblockdev-part-err2 isc-dhcp-client libctf0 libnsl2 libblockdev-utils2 python3-jaraco.classes libprocps8 binutils-common libdns-export1110 libsframe1 pkexec python3-keyring libgprofng0 libcbor0.8 python3.10-minimal perl-modules-5.34 ubuntu-advantage-tools gcc-12-base libblockdev-crypto2 libicu70 libnetplan0 policykit-1 binutils python3-secretstorage                                                         

  after:
  2024-07-16 15:22:22,555 DEBUG The following packages are marked for removal: libperl5.34 python3.10 libctf-nobfd0 libblockdev-part2 libblockdev-swap2 libpcre3 libunistring2 libaio1 libmpdec3 libbinutils python3-jeepney libpython3.10-minimal libblockdev-fs2 libpython3.10-stdlib binuti
  ls-x86-64-linux-gnu irqbalance libbpf0 libtss2-mu0 libldap-2.5-0 isc-dhcp-common libisc-export1105 libappstream4 libpython3.10 libblockdev-loop2 libblockdev2 libblockdev-part-err2 isc-dhcp-client libctf0 libnsl2 libblockdev-utils2 python3-jaraco.classes libprocps8 binutils-common libdns-export1110 libsframe1 pkexec python3-keyring libgprofng0 libcbor0.8 python3.10-minimal perl-modules-5.34 ubuntu-advantage-tools gcc-12-base libblockdev-crypto2 libicu70 libnetplan0 policykit-1 binutils python3-secretstorage

  This small container is not necessarily the best test case to demonstrate it and ensure correctness but the fastest one; it may also be suitable to run it in a desktop VM instead.

  [Where problems could occur]
  The upgrade process could crash in case the solver fails to solve the request it is being given. This is the last step of the upgrade though, so it is reasonable safe.

  One could have skipped on a solver failure but this way we'd get crash reports
  in the unlikely case they happen.

  [Original bug report]

  Test Case:
  1. Fresh Bionic installation from 18.04.4 + all updates applied
  2. Run: update-manager -d
  3. Proceed with the upgrade.

  Actual Result:
  Everything goes well but the stage "Searching for obsolete software" takes a very long time.

  ProblemType: Bug
  DistroRelease: Ubuntu 20.04
  Package: ubuntu-release-upgrader-core 1:20.04.18
  ProcVersionSignature: Ubuntu 5.4.0-26.30-generic 5.4.30
  Uname: Linux 5.4.0-26-generic x86_64
  ApportVersion: 2.20.11-0ubuntu27
  Architecture: amd64
  CasperMD5CheckResult: skip
  CrashDB: ubuntu
  CurrentDesktop: ubuntu:GNOME
  Date: Wed Apr 22 10:34:19 2020
  InstallationDate: Installed on 2020-04-20 (2 days ago)
  InstallationMedia: Ubuntu 18.04.4 LTS "Bionic Beaver" - Release amd64 (20200203.1)
  PackageArchitecture: all
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=<set>
   LANG=en_US.UTF-8
   SHELL=/bin/bash
  SourcePackage: ubuntu-release-upgrader
  Symptom: ubuntu-release-upgrader
  UpgradeStatus: Upgraded to focal on 2020-04-22 (0 days ago)
  VarLogDistupgradeTermlog:

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1874272/+subscriptions