[Bug 2073787] Re: apport-retrace needs more than 1.5 GB memory (when using sandbox)

[Benjamin Drung]

Do we need the lookup for kernel modules in /lib/modules or
/usr/lib/modules? Because those are mainly responsible for the
dictionary growth.

These are the entries in the file2pkg dictionary when filtering these
paths (on amd64 today):

| Path               |    jammy |    noble | questing | resolute |
|--------------------|----------|----------|----------|----------|
| :                  |        0 |        0 |        0 |        0 |
| boot               |     4654 |     2647 |      366 |      137 |
| lib/modules        | 10206350 |  5492830 |   475055 |     9120 |
| usr/[^/]+/include  |   107568 |   170800 |   103340 |   127294 |
| usr/include        |   278938 |   271587 |   295470 |   298389 |
| usr/lib/modules    |        0 |        0 |        0 |    73589 |
| usr/share/doc      |  3025577 |  2938577 |  2636718 |  2766784 |
| usr/share/gocode   |   112802 |   168941 |   199405 |   227626 |
| usr/share/help     |   121470 |   124824 |   118948 |   119346 |
| usr/share/icons    |   605862 |   659375 |   715984 |   753986 |
| usr/share/locale   |    95312 |   110122 |   123230 |   123842 |
| usr/share/man      |   149353 |   165310 |   175262 |   177041 |
| usr/share/texlive  |   145420 |   168740 |   170265 |   171546 |
| usr/src            | 39533381 | 21538896 |  2201315 |   420916 |
| var                |    15759 |    35438 |    37204 |    37552 |
| *current           | 13711111 |  9541912 |  4444324 |  4268204 |
| *proposed          |  3525174 |  4087167 |  4006839 |  4223184 |

*current is this pattern:

```
        path_exclude_pattern = re.compile(
            rb"^:|(boot|var|usr/(include|src|[^/]+/include"
            rb"|share/(doc|gocode|help|icons|locale|man|texlive)))/"
        )
```

*proposed is:
^(lib/modules|usr/(include|src|[^/]+/include|lib/modules|share/(doc|gocode|help|icons|locale|man|texlive)))/

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to apport in Ubuntu.
https://bugs.launchpad.net/bugs/2073787

Title:
  apport-retrace needs more than 1.5 GB memory (when using sandbox)

Status in Apport:
  Triaged
Status in apport package in Ubuntu:
  Triaged

Bug description:
  The system tests test_retrace_system_sandbox and
  test_retrace_jammy_sandbox fail on arm64, ppc64el, s390x, because
  apport-retrace is killed by the OOM killer. Example:

  autopkgtest kernel: Out of memory: Killed process 3597 (apport-
  retrace) total-vm:1512420kB, anon-rss:1241460kB, file-rss:2592kB,
  shmem-rss:0kB, UID:0 pgtables:2554kB oom_score_adj:0

  Log: https://autopkgtest.ubuntu.com/results/autopkgtest-oracular-
  bdrung-apport/oracular/s390x/a/apport/20240722_145904_d3c2f@/log.gz

  apport-retrace should be able to retrace crashes without needing
  multiple gigabytes of memory.

To manage notifications about this bug go to:
https://bugs.launchpad.net/apport/+bug/2073787/+subscriptions