[Bug 1883723] Re: Some official repositories changed compression method from gzip to lz4 leading to checksum errors during apt-get update

[Julian Andres Klode]

You have enabled storing indexes in compressed form, which is a non-
default setting that does not work very well. In early days, this used
to store files in the form the server offered them, but this was changed
to recompress to lz4 in order to improve the run time performance of
apt.

Unfortunately, we are going to need a way to reproduce the issue,
otherwise we can't do much about it. There are likely various bugs in
various places of the downloading process that lead to it using files in
the wrong states.

** Changed in: apt (Ubuntu)
       Status: New => Incomplete

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1883723

Title:
  Some official repositories changed compression method from gzip to lz4
  leading to checksum errors during apt-get update

Status in apt package in Ubuntu:
  Incomplete

Bug description:
  This includes bionic-security repositories:

  Reading package lists... Done
  E: Failed to fetch store:/var/lib/apt/lists/partial/pl.archive.ubuntu.com_ubuntu_dists_bionic-security_Contents-i386.gz  Hash Sum mismatch
     Hashes of expected file:
      - Filesize:821731759 [weak]
      - SHA256:03b7fe601ba17908a5bfc628c8eb8309cd682f88ea5c2ed8139a4d46bb02df09
      - SHA1:5b0ca78303b67f3e1e78c828ac10474f4acf8c10 [weak]
      - MD5Sum:fa890ae0f75a803fa744ce126739bfa6 [weak]
     Hashes of received file:
      - SHA256:9cd965c8d4f68b92cfc20484aabf19899b53718f810dc316f7983c4b194108dd
      - SHA1:7c27b4efd7c3ca176b3e7ed85dec5d865a8928b8 [weak]
      - MD5Sum:c1a1a8baef4d45ce444962b981a

  Failed files:
  nusch at xps13:/etc/apt$ sudo ls -l /var/lib/apt/lists/partial/ | grep FAILED
  lrwxrwxrwx 1 root root       87 cze 16 16:52 pl.archive.ubuntu.com_ubuntu_dists_bionic-proposed_Contents-i386.gz.FAILED -> /var/lib/apt/lists/pl.archive.ubuntu.com_ubuntu_dists_bionic-proposed_Contents-i386.lz4
  lrwxrwxrwx 1 root root       87 cze 16 16:52 pl.archive.ubuntu.com_ubuntu_dists_bionic-security_Contents-i386.gz.FAILED -> /var/lib/apt/lists/pl.archive.ubuntu.com_ubuntu_dists_bionic-security_Contents-i386.lz4

  Not sure from where this issue comes - manual browsing of repository
  discovers only .gz file while downloaded copy have lz4 extension.
  After manual downloading .gz one and uncompromising diff command
  confirms both produce the same file.  Apt-get clean and deleting cache
  doesn't help.

  ProblemType: Bug
  DistroRelease: Ubuntu 18.04
  Package: apt 1.6.12ubuntu0.1
  ProcVersionSignature: Ubuntu 4.15.0-107.108-generic 4.15.18
  Uname: Linux 4.15.0-107-generic x86_64
  NonfreeKernelModules: wl
  ApportVersion: 2.20.9-0ubuntu7.15
  Architecture: amd64
  CurrentDesktop: ubuntu:GNOME
  Date: Tue Jun 16 16:49:31 2020
  InstallationDate: Installed on 2015-05-08 (1866 days ago)
  InstallationMedia: Ubuntu 15.04 "Vivid Vervet" - Release amd64 (20150422)
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=<set>
   LANG=pl_PL.UTF-8
   SHELL=/bin/bash
  SourcePackage: apt
  UpgradeStatus: Upgraded to bionic on 2018-08-26 (659 days ago)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1883723/+subscriptions