[Bug 1971959] Re: [UBUNTU 22.04] dbginfo.sh: stabilization of data collection

Thu Jun 23 18:44:34 UTC 2022

Test on z/VM:
"
$ dpkg -l s390-tools
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name           Version           Architecture Description
+++-==============-=================-============-=============================>
ii  s390-tools     2.20.0-0ubuntu3.1 s390x        fundamental utilities for Lin>

$ sudo dbginfo.sh
dbginfo.sh: Debug information script version 2.20.0-build-20220623
Copyright IBM Corp. 2002, 2022

Hardware platform     = s390x
Runtime environment   = z/VM
Kernel version        = 5.15.0 (5.15.0-39-generic)
OS version / distro   = Ubuntu 22.04 LTS
Date and time of info = 2022-06-23-18-20-06

1 of 18: Collecting sysfs
 Warning: falling back to slow path
2 of 18: Collecting procfs
3 of 18: Collecting config files
4 of 18: Collecting command output
5 of 18: Collecting hyptop for z/VM - 5s output
6 of 18: Collecting z/VM output
dbginfo.sh: Warning: No program to communicate to z/VM CP
6 of 18: Skip z/VM: vmcp not available
7 of 18: Collecting network output
8 of 18: Skip osa oat: qethqoat not available
9 of 18: Skip ethtool: not available
10 of 18: Skip Trafic Control: tc not available
11 of 18: Skip bridge: not available
12 of 18: Skip OpenVSwitch: ovs-vsctl not available
13 of 18: Skip KVM: no virsh command
14 of 18: Skip docker: not available
15 of 18: Skip nvme: not available
16 of 18: Collecting log files
 0 logfiles over 50 MB
17 of 18: Postprocessing
18 of 18: Finalizing: Creating archive with collected data

Collected data was saved to:
 >>  /tmp/DBGINFO-2022-06-23-18-20-06-hwe0003-118F67.tgz  <<

Please review all collected data before sending to your service organization.

$ ls -l /tmp/DBGINFO-2022-06-23-18-20-06-hwe0003-118F67.tgz
-rw------- 1 root root 5907470 Jun 23 18:20 /tmp/DBGINFO-2022-06-23-18-20-06-hwe0003-118F67.tgz
"

and test on LPAR:

"
$ dpkg -l s390-tools
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name           Version           Architecture Description
+++-==============-=================-============-=============================>
ii  s390-tools     2.20.0-0ubuntu3.1 s390x        fundamental utilities for Lin>

$ sudo dbginfo.sh 
dbginfo.sh: Debug information script version 2.20.0-build-20220623
Copyright IBM Corp. 2002, 2022

Hardware platform     = s390x
Runtime environment   = LPAR
Kernel version        = 5.15.0 (5.15.0-23-generic)
OS version / distro   = Ubuntu 22.04 LTS
Date and time of info = 2022-06-23-18-20-08

1 of 18: Collecting sysfs
 Warning: falling back to slow path
2 of 18: Collecting procfs
3 of 18: Collecting config files
4 of 18: Collecting command output
5 of 18: Collecting hyptop for LPAR - 5s output
6 of 18: Skip z/VM: no z/VM environment
7 of 18: Collecting network output
8 of 18: Skip osa oat: qethqoat not available
9 of 18: Skip ethtool: not available
10 of 18: Skip Trafic Control: tc not available
11 of 18: Skip bridge: not available
12 of 18: Skip OpenVSwitch: ovs-vsctl not available
13 of 18: Skip KVM: no virsh command
14 of 18: Skip docker: not available
15 of 18: Skip nvme: not available
16 of 18: Collecting log files
 0 logfiles over 50 MB
17 of 18: Postprocessing
18 of 18: Finalizing: Creating archive with collected data

Collected data was saved to:
 >>  /tmp/DBGINFO-2022-06-23-18-20-08-s1lp14-1E8F67.tgz  <<

Please review all collected data before sending to your service organization.

$ ls -l /tmp/DBGINFO-2022-06-23-18-20-08-s1lp14-1E8F67.tgz
-rw------- 1 root root 9341814 Jun 23 18:21 /tmp/DBGINFO-2022-06-23-18-20-08-s1lp14-1E8F67.tgz
"

worked flawlessly and create a reasonable sized file (and content).

Hence updated tags to verification done.

** Tags removed: verification-needed verification-needed-jammy
** Tags added: verification-done verification-done-jammy

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to s390-tools in Ubuntu.
https://bugs.launchpad.net/bugs/1971959

Title:
  [UBUNTU 22.04] dbginfo.sh: stabilization of data collection

Status in Ubuntu on IBM z Systems:
  Fix Committed
Status in s390-tools package in Ubuntu:
  Fix Released
Status in s390-tools source package in Jammy:
  Fix Committed
Status in s390-tools source package in Kinetic:
  Fix Released

Bug description:
  SRU Justification:
  ==================

  [Impact]

   * The s390x-specific dbginfo.sh script, used to collect runtime,
     configuration and trace information for debugging Linux on IBM Z,
     has stabilization issues while collecting data.

   * Script hangups are possible on single commands,

   * potentially missing data collection on error

   * and overwrites of buffers by diag commands.

  [Test Plan]

   * Prepare an IBM zSystems or LinuxONE system
     (ideally an LPAR as well as a z/VM guest)
     with an Ubuntu 22.04 system.

   * The s390-tools package is mandatory and always installed,
     but needs to be replaced with an updated/fixed version -
     pick the version from the PPA that is mentioned below.

   * Execute dbginfo.sh (as root or with sudo).

   * Monitor the output and verify if all 18 steps are completed,
     without any crashes or hangs.

   * Inspect the size and content of the result file:
     /tmp/DBGINFO-*.tgz

  [Where problems could occur]

   * The script might no run on older generations anymore.

   * Some of the things that are gathered might not be
     properly picked (like z/VM data on LPAR).

   * If a step fails (like in the past), no summarized
     output might be generated.

  __________

  Description:   dbginfo.sh: stabilization of data collection
  Symptom:        - script hangup possible on single commands
                  - missing data collection on error
                  - overwrite of buffers by diag commands
  Problem:       hangup and loss of data collection
  Solution:      rework code regarding
                  - add timeout function
                  - remove problematic commands
                  - include handling improvements
  Component:     s390-tools

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-z-systems/+bug/1971959/+subscriptions