[Bug 1935617] Re: systemd autopkgtest broken on ppc64el with qemu 6.0

[Christian Ehrhardt ]

I installed a ppc64 impish cloud image (all fine) but then ran it in TCG
mode (to check if I can trigger the same).

That starts it like:
/usr/bin/qemu-system-ppc64le -name guest=i-systemdtest,debug-threads=on -S -object {"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-1-i-systemdtest/master-key.aes"} -machine pseries-impish,accel=tcg,usb=off,dump-guest-core=off,memory-backend=ppc_spapr.ram -cpu POWER9 -m 2048 ...

So it uses accel=tcg as intended, but other than the systemd testbed it has ssh and apt for debugging.
Gladly it seems reproducible there as well.

So we can add to the above TL;DR:
 - also reproducible in impish cloud images (not just systemd)

In fact after a boot I already have plenty of crashes.

-rw-r-----  1 root      root   253783 Jul 12 13:43 _usr_bin_chgrp.0.crash
-rw-r-----  1 root      root   208344 Jul 12 13:47 _usr_bin_chmod.0.crash
-rw-r-----  1 root      root   338077 Jul 12 13:52 _usr_bin_find.0.crash
-rw-r-----  1 root      root   218387 Jul 12 13:52 _usr_bin_rm.0.crash
-rw-r-----  1 ubuntu    ubuntu 226114 Jul 12 13:52 _usr_bin_rm.1000.crash
-rw-r-----  1 pollinate daemon 224894 Jul 12 13:43 _usr_bin_rm.111.crash
... growing ...

With that it seems odd that it boots and works just fine.
A praise to the stability of a modern Linux ...

Also apt is rather unlucky - like
Unpacking libdebuginfod-common (0.185-1) ...
dpkg: error while cleaning up:
 rm command for cleanup subprocess was killed by signal (Segmentation fault), core dumped
dpkg: error processing archive /tmp/apt-dpkg-install-1jDo19/1-libbabeltrace1_1.5.8-1build3_ppc64el.deb (--unpack):
 rm command for cleanup subprocess was killed by signal (Segmentation fault), core dumped
...


I let it crash a bunch of things and switched back to KVM mode to then do the debugging with GDB on the crash files.

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to systemd in Ubuntu.
https://bugs.launchpad.net/bugs/1935617

Title:
  systemd autopkgtest broken on ppc64el with qemu 6.0

Status in qemu package in Ubuntu:
  New
Status in systemd package in Ubuntu:
  New

Bug description:
  I'm not sure yet if this is flaky or a real issue, but I'm filing it
  to avoid multiple people analyzing the same.

  The Qemu 6.0 upload https://launchpad.net/ubuntu/+source/qemu/1:6.0+dfsg-1~ubuntu2 triggers a test failure like
  https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/ppc64el/s/systemd/20210708_223311_e3bbb@/log.gz

  I have tested the new qemu on ppc64 and it worked fine for device emulation and migration cases.
  But this is suspicious.
  Of the last tests exactly and only those with the new qemu failed.

  
  impish
    ppc64el
      tests-in-lxd                   (F  5% f  0% S  0% B  0% => P 95%/) F.........F.............................
      systemd-fsckd                  (F  0% f  0% S 100% B  0% => P  0%/) SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
      upstream-1                     (F 15% f  0% S  0% B  0% => P 85%/) F..FFFF....F............................
      upstream-2                     (F 12% f  0% S  0% B  0% => P 87%/) F..FFFF.................................

  
  For an insight in flakyness/reproducibility I've retriggered the missing qemu and the non-qemu cases a few times. If those reproduce all-bad vs all-good again this would further indicate a real issue.

  Unfortunately the ppc maas seems down right now and canonistack also
  isn't too nice this week - overall that inhibits the testing a bit :-/

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1935617/+subscriptions