[Bug 1599646] Re: E-mail report contains repeated "Reading database ... NN%" lines

Fri Feb 22 10:30:07 UTC 2019

Verified with unattended-upgrades/1.1ubuntu1.18.04.9 on Bionic:

https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac
/autopkgtest-bionic/bionic/amd64/u/unattended-
upgrades/20190221_190835_4cafb@/log.gz :

...
From: root <root at autopkgtest>
Message-Id: <E1gwsoF-0001Qi-Gv at autopkgtest>
Date: Thu, 21 Feb 2019 18:10:59 +0000

Unattended upgrade returned: True

Packages that were upgraded:
 apparmor apport apt apt-utils base-files dirmngr distro-info-data 
 file gnupg gnupg-l10n gnupg-utils gpg gpg-agent gpg-wks-client 
 gpg-wks-server gpgconf gpgsm gpgv gvfs gvfs-common gvfs-daemons 
 gvfs-libs initramfs-tools initramfs-tools-bin initramfs-tools-core 
 krb5-locales libapparmor1 libapt-inst2.0 libapt-pkg5.0 
 libavahi-client3 libavahi-common-data libavahi-common3 
 libavahi-glib1 libcaca0 libcups2 libdns-export1100 libgcrypt20 
 libglib2.0-0 libglib2.0-data libgssapi-krb5-2 libisc-export169 
 libjavascriptcoregtk-4.0-18 libjpeg-turbo-progs libjpeg-turbo8 
 libk5crypto3 libkrb5-3 libkrb5support0 liblcms2-2 libmagic-mgc 
 libmagic1 libmysqlclient20 libnss-systemd libnss3 libpam-systemd 
 libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0 libperl5.26 
 libpng16-16 libpolkit-agent-1-0 libpolkit-backend-1-0 
 libpolkit-gobject-1-0 libpoppler-glib8 libpoppler73 libprocps6 
 libpython2.7 libpython2.7-minimal libpython2.7-stdlib 
 libsoup-gnome2.4-1 libsoup2.4-1 libssl1.1 libsystemd0 libtiff5 
 libudev1 libudisks2-0 libwavpack1 libwebkit2gtk-4.0-37 libx11-6 
 libx11-data libx11-xcb1 libxkbcommon0 libxml2 netplan.io nplan 
 openssl perl perl-base perl-modules-5.26 policykit-1 procps 
 python3-apport python3-problem-report python3-requests systemd 
 systemd-sysv tzdata udev udisks2 xserver-common xserver-xorg-core 
 xserver-xorg-legacy 

Package installation log:
Log started: 2019-02-21  18:09:19
Preconfiguring packages ...
Preparing to unpack .../apparmor_2.12-4ubuntu5.1_amd64.deb ...
Unpacking apparmor (2.12-4ubuntu5.1) over (2.12-4ubuntu5) ...
Setting up apparmor (2.12-4ubuntu5.1) ...
Installing new version of config file /etc/apparmor.d/abstractions/private-files ...
Installing new version of config file /etc/apparmor.d/abstractions/private-files-strict ...
Installing new version of config file /etc/apparmor.d/abstractions/ubuntu-browsers.d/user-files ...
Processing triggers for systemd (237-3ubuntu10) ...
Processing triggers for man-db (2.8.3-2) ...
Log ended: 2019-02-21  18:09:20
...

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to unattended-upgrades in Ubuntu.
https://bugs.launchpad.net/bugs/1599646

Title:
  E-mail report contains repeated "Reading database ... NN%" lines

Status in unattended-upgrades package in Ubuntu:
  Fix Released
Status in unattended-upgrades source package in Bionic:
  Fix Committed
Status in unattended-upgrades source package in Cosmic:
  Fix Committed
Status in apt package in Debian:
  New

Bug description:
  [Impact]

   * Unattended-upgrades sends the following repeating dpkg progress lines with almost no informational value in the email report:
  ...
   (Reading database ...
   (Reading database ... 5%
   (Reading database ... 10%
   (Reading database ... 15%
   (Reading database ... 20%
   (Reading database ... 25%
   (Reading database ... 30%
   (Reading database ... 35%
   (Reading database ... 40%
   (Reading database ... 45%
   (Reading database ... 50%
   (Reading database ... 55%
   (Reading database ... 60%
   (Reading database ... 65%
   (Reading database ... 70%
   (Reading database ... 75%
   (Reading database ... 80%
   (Reading database ... 85%
   (Reading database ... 90%
   (Reading database ... 95%
  (Reading database ... 60486 files and directories currently installed.)
  ...

   * This makes the report email too verbose and makes harder to spot
  real problems.

  [Test Case]

   * Run package autopkgtest and observe no such lines in the echoed
  email in upgrade-all-security and upgrade-between-snapshots tests.

  [Regression Potential]

   * The fix filters dpkg's output only and in the worst case other
  lines could be missing or u-u could crash. Since the applied hard-
  coded regex pattern is fairly simple and we observed no crashes in the
  tests those regressions are unlikey to occur.

  [Originial Bug Text]

  This concerns unattended-upgrades 0.90 in Xenial.

  Here is an excerpt from an e-mail report sent out by u-u after the
  upgrade process is completed:

   Package installation log:
   Log started: 2016-07-06  17:24:21
   Preconfiguring packages ...
   (Reading database ...
   (Reading database ... 5%
   (Reading database ... 10%
   (Reading database ... 15%
   (Reading database ... 20%
   (Reading database ... 25%
   (Reading database ... 30%
   (Reading database ... 35%
   (Reading database ... 40%
   (Reading database ... 45%
   (Reading database ... 50%
   (Reading database ... 55%
   (Reading database ... 60%
   (Reading database ... 65%
   (Reading database ... 70%
   (Reading database ... 75%
   (Reading database ... 80%
   (Reading database ... 85%
   (Reading database ... 90%
   (Reading database ... 95%
   (Reading database ... 100%
   (Reading database ... 314949 files and directories currently installed.)
   Preparing to unpack .../tzdata_2016f-0ubuntu0.16.04_all.deb ...
   Unpacking tzdata (2016f-0ubuntu0.16.04) over (2016d-0ubuntu0.16.04) ...
   Preparing to unpack .../libgimp2.0_2.8.16-1ubuntu1.1_i386.deb ...

  All but the last "Reading database ..." line should be elided from the
  message.

  As a matter of fact, those lines do not appear in messages mailed out
  from current Trusty systems (u-u version 0.82.1ubuntu2.4), so this
  appears to be a regression.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/unattended-upgrades/+bug/1599646/+subscriptions