[Bug 1870811] Re: compile auto test failure, and root-unittest failure, is extremely noisy

[Dan Streetman]

no build failures to verify this bug with, but manually adding build
test failure shows both bionic and eoan correctly display the build test
failure summary:

bionic:

OK:       233
FAIL:       1
SKIP:      20
TIMEOUT:    0


The output from the failed tests:

 50/254 test-network                            FAIL     0.79 s

--- command ---
SYSTEMD_KBD_MODEL_MAP='/build/lp1870811/systemd-237/src/locale/kbd-model-map' SYSTEMD_LANGUAGE_FALLBACK_MAP='/build/lp1870811/systemd-237/src/locale/language-fallback-map' PATH='/build/lp1870811/systemd-237/build-deb:/home/ubuntu/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin' /build/lp1870811/systemd-237/build-deb/test-network
--- stderr ---
Assertion '1 == 0' failed at ../src/network/test-network.c:65, function test_deserialize_dhcp_routes(). Aborting.
-------


eoan:

Ok:                  505
Expected Fail:         0
Fail:                  1
Unexpected Pass:       0
Skipped:              13
Timeout:               0


The output from the failed tests:

284/519 test-network                            FAIL     0.62 s (killed
by signal 6 SIGABRT)

--- command ---
SYSTEMD_KBD_MODEL_MAP='/build/lp1870811/systemd-242/src/locale/kbd-model-map' SYSTEMD_LANGUAGE_FALLBACK_MAP='/build/lp1870811/systemd-242/src/locale/language-fallback-map' PATH='/build/lp1870811/systemd-242/build-deb:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin' /build/lp1870811/systemd-242/build-deb/test-network
--- stderr ---
Assertion '1 == 0' failed at ../src/network/test-network.c:49, function test_deserialize_dhcp_routes(). Aborting.
-------


** Tags removed: verification-needed verification-needed-bionic verification-needed-eoan
** Tags added: verification-done verification-done-bionic verification-done-eoan

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to systemd in Ubuntu.
https://bugs.launchpad.net/bugs/1870811

Title:
  compile auto test failure, and root-unittest failure, is extremely
  noisy

Status in systemd package in Ubuntu:
  Fix Released
Status in systemd source package in Xenial:
  Won't Fix
Status in systemd source package in Bionic:
  Fix Committed
Status in systemd source package in Eoan:
  Fix Committed
Status in systemd source package in Focal:
  Fix Released

Bug description:
  [impact]

  failure in the compile-time tests (also run from the root-unittest
  autopkgtest) prints out the entire meson testlog.txt, which shows the
  output of all tests, including passed ones, not just the failed test
  output.  This makes it extremely difficult to find the output of the
  failed test(s) and creates a massive log to download.

  [test case]

  see any failed build, e.g.
  https://launchpadlibrarian.net/471257226/buildlog_ubuntu-eoan-amd64.systemd_245.218-g69d06b7acf+19.10.20200328163536_BUILDING.txt.gz

  [regression potential]

  any regression would likely occur during test failure, likely
  resulting in lack of details of the test failure; or, a regression
  caused by the additional meson parameter could cause build failure.

  [scope]

  Xenial does not use meson, so can not be adjusted.  This is needed in
  Bionic and later.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1870811/+subscriptions