[Bug 1737635] Re: Invalid UTF-8 characters in dpkg's log crash unattended-upgrade.

[Balint Reczey]

** Description changed:

+ [Impact]
+ 
+  * Unattended-upgrades crashes at the end of its run before sending out
+ upgrade report email when dpkg's log contains invalid UTF-8 characters.
+ 
+ 
+ [Test Case]
+ 
+  * Observe
+ https://errors.ubuntu.com/problem/4617feba656f6ec216996b0f1f662ae13904b9f8
+ not occurring again
+ 
+ [Regression Potential]
+ 
+  * The fix is minimal, only replacing invalid characters with �.
+ Regressions in u-u are unlikely but tools may break consuming
+ unattended-upgrades output in case they can't handle the replacement
+ marker.
+ 
+ [Original Bug Text]
+ 
  The Ubuntu Error Tracker has been receiving reports about a problem regarding unattended-upgrades.  This problem was most recently seen with package version 0.98ubuntu1, the problem page at https://errors.ubuntu.com/problem/2fa32547e0d8e7186a0a805e3db6f50317c0dafa contains more details, including versions of packages affected, stacktrace or traceback, and individual crash reports.
  If you do not have access to the Ubuntu Error Tracker and are a software developer, you can request it at http://forms.canonical.com/reports/.
  
  Traceback (most recent call last):
-   File "/usr/bin/unattended-upgrade", line 1706, in <module>
-     main(options)
-   File "/usr/bin/unattended-upgrade", line 1619, in main
-     log_content = get_dpkg_log_content(logfile_dpkg, install_start_time)
-   File "/usr/bin/unattended-upgrade", line 1229, in get_dpkg_log_content
-     for line in fp.readlines():
-   File "/usr/lib/python3.6/codecs.py", line 321, in decode
-     (result, consumed) = self._buffer_decode(data, self.errors, final)
+   File "/usr/bin/unattended-upgrade", line 1706, in <module>
+     main(options)
+   File "/usr/bin/unattended-upgrade", line 1619, in main
+     log_content = get_dpkg_log_content(logfile_dpkg, install_start_time)
+   File "/usr/bin/unattended-upgrade", line 1229, in get_dpkg_log_content
+     for line in fp.readlines():
+   File "/usr/lib/python3.6/codecs.py", line 321, in decode
+     (result, consumed) = self._buffer_decode(data, self.errors, final)
  UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 7912-7913: invalid continuation byte

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to unattended-upgrades in Ubuntu.
https://bugs.launchpad.net/bugs/1737635

Title:
  Invalid UTF-8 characters in dpkg's log crash unattended-upgrade.

Status in unattended-upgrades package in Ubuntu:
  Fix Released

Bug description:
  [Impact]

   * Unattended-upgrades crashes at the end of its run before sending
  out upgrade report email when dpkg's log contains invalid UTF-8
  characters.

  
  [Test Case]

   * Observe
  https://errors.ubuntu.com/problem/4617feba656f6ec216996b0f1f662ae13904b9f8
  not occurring again

  [Regression Potential]

   * The fix is minimal, only replacing invalid characters with �.
  Regressions in u-u are unlikely but tools may break consuming
  unattended-upgrades output in case they can't handle the replacement
  marker.

  [Original Bug Text]

  The Ubuntu Error Tracker has been receiving reports about a problem regarding unattended-upgrades.  This problem was most recently seen with package version 0.98ubuntu1, the problem page at https://errors.ubuntu.com/problem/2fa32547e0d8e7186a0a805e3db6f50317c0dafa contains more details, including versions of packages affected, stacktrace or traceback, and individual crash reports.
  If you do not have access to the Ubuntu Error Tracker and are a software developer, you can request it at http://forms.canonical.com/reports/.

  Traceback (most recent call last):
    File "/usr/bin/unattended-upgrade", line 1706, in <module>
      main(options)
    File "/usr/bin/unattended-upgrade", line 1619, in main
      log_content = get_dpkg_log_content(logfile_dpkg, install_start_time)
    File "/usr/bin/unattended-upgrade", line 1229, in get_dpkg_log_content
      for line in fp.readlines():
    File "/usr/lib/python3.6/codecs.py", line 321, in decode
      (result, consumed) = self._buffer_decode(data, self.errors, final)
  UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 7912-7913: invalid continuation byte

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/unattended-upgrades/+bug/1737635/+subscriptions