[Bug 1878225] Re: Please remove lxd.snap from lxd images, as it fails to seed thus failing the first boot - snapd.seeded.service waits forever (?) to have snaps seeded in LXD on s390x and arm64

[Stéphane Graber]

I've managed to reproduce this issue by reproducing the network setup of
autopkgtest.

All you have to do is setup your network to allow access only through an
http proxy and drop all other traffic. Do that and you'll get:

stgraber at castiana:~$ autopkgtest-build-lxd ubuntu-daily:groovy
Creating autopkgtest-prepare-yzE
Starting autopkgtest-prepare-yzE
Created symlink /etc/systemd/system/serial-getty at getty.service → /dev/null.
Timed out waiting for container to boot
stgraber at castiana:~$ 

Note that the autopkgtest network drops traffic, it doesn't reject it,
so you're not hitting normal connection failures that can be nicely
handled. As a result snapd gets stuck in seeding.

Manually fixing the autopkgtest-build-lxd script to configure snapd's
proxy in the container, gets you.


stgraber at castiana:~$ autopkgtest-build-lxd ubuntu-daily:groovy
Creating autopkgtest-prepare-ybH
Starting autopkgtest-prepare-ybH
Created symlink /etc/systemd/system/serial-getty at getty.service → /dev/null.
Container finished booting. Distribution Ubuntu, release groovy, architecture amd64
Running setup script /usr/share/autopkgtest/setup-commands/setup-testbed...
sh: Attempting to set up Debian/Ubuntu apt sources automatically
sh: Distribution appears to be Ubuntu
Get:1 http://us.archive.ubuntu.com/ubuntu groovy InRelease [267 kB]
Hit:2 http://us.archive.ubuntu.com/ubuntu groovy-updates InRelease
Hit:3 http://us.archive.ubuntu.com/ubuntu groovy-security InRelease
Get:4 http://us.archive.ubuntu.com/ubuntu groovy/main Sources [841 kB]
Get:5 http://us.archive.ubuntu.com/ubuntu groovy/multiverse Sources [177 kB]
Get:6 http://us.archive.ubuntu.com/ubuntu groovy/universe Sources [9906 kB]
Get:7 http://us.archive.ubuntu.com/ubuntu groovy/restricted Sources [6476 B]
Get:8 http://us.archive.ubuntu.com/ubuntu groovy/main amd64 Packages [975 kB]
Get:9 http://us.archive.ubuntu.com/ubuntu groovy/main amd64 c-n-f Metadata [29.5 kB]
Get:10 http://us.archive.ubuntu.com/ubuntu groovy/universe amd64 Packages [8734 kB]
Get:11 http://us.archive.ubuntu.com/ubuntu groovy/universe amd64 c-n-f Metadata [267 kB]
Get:12 http://us.archive.ubuntu.com/ubuntu groovy/multiverse amd64 Packages [154 kB]
Get:13 http://us.archive.ubuntu.com/ubuntu groovy/multiverse amd64 c-n-f Metadata [9320 B]
Get:14 http://us.archive.ubuntu.com/ubuntu groovy-updates/universe amd64 c-n-f Metadata [112 B]
Get:15 http://us.archive.ubuntu.com/ubuntu groovy-updates/multiverse amd64 c-n-f Metadata [116 B]
Get:16 http://us.archive.ubuntu.com/ubuntu groovy-security/universe amd64 c-n-f Metadata [116 B]
Get:17 http://us.archive.ubuntu.com/ubuntu groovy-security/multiverse amd64 c-n-f Metadata [116 B]
Fetched 21.4 MB in 4s (4957 kB/s)

Marking all tasks invalid and re-opening autopkgtest task as that's
what's broken here.

** Changed in: lxd (Ubuntu)
       Status: Incomplete => Invalid

** Changed in: snapd (Ubuntu)
       Status: Confirmed => Invalid

** Changed in: snapd
       Status: New => Invalid

** Changed in: cloud-images
       Status: New => Invalid

** Changed in: autopkgtest (Ubuntu)
       Status: Invalid => Triaged

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to autopkgtest in Ubuntu.
https://bugs.launchpad.net/bugs/1878225

Title:
  Please remove lxd.snap from lxd images, as it fails to seed thus
  failing the first boot - snapd.seeded.service waits forever (?) to
  have snaps seeded in LXD on s390x and arm64

Status in Auto Package Testing:
  Invalid
Status in cloud-images:
  Invalid
Status in snapd:
  Invalid
Status in autopkgtest package in Ubuntu:
  Triaged
Status in lxd package in Ubuntu:
  Invalid
Status in snapd package in Ubuntu:
  Invalid

Bug description:
  lxc launch ubuntu-daily:groovy gg-test
  lxc shell gg-test
  root at gg-test:~# service snapd.seeded status
  ● snapd.seeded.service - Wait until snapd is fully seeded
       Loaded: loaded (/lib/systemd/system/snapd.seeded.service; enabled; vendor preset: enabled)
       Active: activating (start) since Tue 2020-05-12 14:14:52 UTC; 30min ago
     Main PID: 249 (snap)
        Tasks: 10 (limit: 4704)
       Memory: 11.3M
       CGroup: /system.slice/snapd.seeded.service
               └─249 /usr/bin/snap wait system seed.loaded

  May 12 14:14:52 gg-test systemd[1]: Starting Wait until snapd is fully
  seeded...

  root at gg-test:~# systemctl list-jobs 
  JOB UNIT                                 TYPE  STATE  
  132 systemd-update-utmp-runlevel.service start waiting
  119 cloud-config.service                 start waiting
  122 snapd.seeded.service                 start running
  2   multi-user.target                    start waiting
  115 cloud-init.target                    start waiting
  1   graphical.target                     start waiting
  138 snapd.autoimport.service             start waiting
  121 cloud-final.service                  start waiting

  8 jobs listed.

  root at gg-test:~# journalctl -a | pastebinit
  https://paste.ubuntu.com/p/PtdcvvdKCM/

To manage notifications about this bug go to:
https://bugs.launchpad.net/auto-package-testing/+bug/1878225/+subscriptions