[Bug 1974223] Re: FTBFS and autopkgtest failure since changes in apt for automatic kernel removal

[Julian Andres Klode]

I ran the tests in lxd, I'm not sure that's sufficient, but:

on bionic:

upgrade-all-security FAIL non-zero exit status 1

focal failed to build for me in autopkgtest:

2022-05-20 10:04:12,150 ERROR Exception happened during upgrade.
Traceback (most recent call last):
  File "/tmp/autopkgtest.7B08MG/build.ZME/src/test/unattended_upgrade.py", line 863, in cache_commit
    res = cache.commit(install_progress=iprogress)
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 686, in commit
    raise SystemError("installArchives() failed")
SystemError: installArchives() failed
2022-05-20 10:04:12,157 ERROR Auto-removing the packages failed!
2022-05-20 10:04:12,158 ERROR Error message: installArchives() failed
2022-05-20 10:04:12,159 ERROR dpkg returned an error! See ./root.unused-deps/var/log/unattended-upgrades/unattended-upgrades-dpkg.log for details
2022-05-20 10:04:12,159 DEBUG InstCount=0 DelCount=0 BrokenCount=0
2022-05-20 10:04:12,161 DEBUG Extracting content from ./root.unused-deps/var/log/unattended-upgrades/unattended-upgrades-dpkg.log since 2022-05-20 10:04:10

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to unattended-upgrades in Ubuntu.
https://bugs.launchpad.net/bugs/1974223

Title:
  FTBFS and autopkgtest failure since changes in apt for automatic
  kernel removal

Status in unattended-upgrades package in Ubuntu:
  Fix Released
Status in unattended-upgrades source package in Bionic:
  New
Status in unattended-upgrades source package in Focal:
  New
Status in unattended-upgrades package in Debian:
  Fix Released

Bug description:
  [Impact]
  Since the following changes in apt have landed in focal-updates (and is currently in bionic-proposed), unattended-upgrades FTBFS and fails autopkgtest on both series:

    * Revert "Protect currently running kernel at run-time"
    * Backport Determine autoremovable kernels at run-time (LP: #1615381) as of
      2.4.5; including the change to only protect two kernels, not last installed
      one (LP: #1968154)

  ======================================================================
  FAIL: test_remove_unused_dependencies_new_unused_only (__main__.TestRemoveUnused)
  ----------------------------------------------------------------------
  Traceback (most recent call last):
    File "./test_remove_unused.py", line 165, in test_remove_unused_dependencies_new_unused_only
      haystack))
  AssertionError: False is not true : Can not find 'Removing unused kernel packages: linux-image-4.05.0-1021-kvm

  [Test plan]
  1. focal:
    * run autopkgtest against -updates:
      $ autopkgtest unattended-upgrades --apt-upgrade --apt-pocket=updates --test-name run-tests -- <virt-server ...>
    * try to build the package
  2. bionic:
    * run autopkgtest against -proposed:
      $ autopkgtest unattended-upgrades --apt-upgrade --apt-pocket=proposed --test-name run-tests -- <virt-server ...>
    * try to build the package

  [Where problems could occur]
    * The fix only affects the test-suite (that runs both at build time & autopkgtest time) so the impact should be minimal. Something wrong in the patch would make the unattended package FTBFS or fail autopkgtest but it is already failing ATM.
    * The new tests dependency on apt can trigger more autopkgtest runs. Since unattended-upgrades has a non-trivial autopkgtest suite, this can have a slight impact on the queues.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/unattended-upgrades/+bug/1974223/+subscriptions