[Bug 2073115] Re: Error EIO: Module 'dashboard' has experienced an error and cannot handle commands: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

[Felipe Reyes]

I'm getting this error in a testing environment.

Another set of upstream bugs that are relevant:

https://github.com/pyca/bcrypt/issues/694
https://github.com/PyO3/pyo3/issues/3451


$ apt policy ceph-mgr-dashboard 
ceph-mgr-dashboard:
  Installed: 19.2.1-0ubuntu0.24.04.2
  Candidate: 19.2.1-0ubuntu0.24.04.2
  Version table:
 *** 19.2.1-0ubuntu0.24.04.2 500
        500 http://availability-zone-3.clouds.archive.ubuntu.com/ubuntu noble-updates/universe amd64 Packages
        100 /var/lib/dpkg/status
     19.2.0-0ubuntu0.24.04.2 500
        500 http://security.ubuntu.com/ubuntu noble-security/universe amd64 Packages
     19.2.0~git20240301.4c76c50-0ubuntu6 500
        500 http://availability-zone-3.clouds.archive.ubuntu.com/ubuntu noble/universe amd64 Packages


Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]: The Application mounted at '' has an empty config.
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]: 2025-08-14T22:15:56.313+0000 744d27dff6c0 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'dashboard' while running on mgr.juju-c52647-zaza-b8a9fdca4c8f-2: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]: 2025-08-14T22:15:56.313+0000 744d27dff6c0 -1 dashboard.serve:
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]: 2025-08-14T22:15:56.313+0000 744d27dff6c0 -1 Traceback (most recent call last):
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/usr/share/ceph/mgr/dashboard/module.py", line 574, in serve
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     uri = self.await_configuration()
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:           ^^^^^^^^^^^^^^^^^^^^^^^^^^
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/usr/share/ceph/mgr/dashboard/module.py", line 211, in await_configuration
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     uri = self._configure()
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:           ^^^^^^^^^^^^^^^^^
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/usr/share/ceph/mgr/dashboard/module.py", line 172, in _configure
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     verify_tls_files(cert_fname, pkey_fname)
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/usr/share/ceph/mgr/mgr_util.py", line 672, in verify_tls_files
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     verify_cacrt(cert_fname)
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/usr/share/ceph/mgr/mgr_util.py", line 598, in verify_cacrt
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     verify_cacrt_content(f.read())
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/usr/share/ceph/mgr/mgr_util.py", line 570, in verify_cacrt_content
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     from OpenSSL import crypto
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/lib/python3/dist-packages/OpenSSL/__init__.py", line 8, in <module>
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     from OpenSSL import SSL, crypto
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/lib/python3/dist-packages/OpenSSL/SSL.py", line 9, in <module>
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     from OpenSSL._util import (
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/lib/python3/dist-packages/OpenSSL/_util.py", line 6, in <module>
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     from cryptography.hazmat.bindings.openssl.binding import Binding
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/lib/python3/dist-packages/cryptography/hazmat/bindings/openssl/binding.py", line 15, in <module>
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     from cryptography.exceptions import InternalError
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:   File "/lib/python3/dist-packages/cryptography/exceptions.py", line 9, in <module>
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]:     from cryptography.hazmat.bindings._rust import exceptions as rust_exceptions
Aug 14 22:15:56 juju-c52647-zaza-b8a9fdca4c8f-2 ceph-mgr[9123]: ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process


** Bug watch added: github.com/pyca/bcrypt/issues #694
   https://github.com/pyca/bcrypt/issues/694

** Bug watch added: github.com/PyO3/pyo3/issues #3451
   https://github.com/PyO3/pyo3/issues/3451

** Also affects: ceph (Ubuntu)
   Importance: Undecided
       Status: New

** Also affects: ceph (Ubuntu Noble)
   Importance: Undecided
       Status: New

** Also affects: ceph (Ubuntu Plucky)
   Importance: Undecided
       Status: New

** Also affects: ceph (Ubuntu Questing)
   Importance: Undecided
       Status: New

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to ceph in Ubuntu.
https://bugs.launchpad.net/bugs/2073115

Title:
  Error EIO: Module 'dashboard' has experienced an error and cannot
  handle commands: PyO3 modules compiled for CPython 3.8 or older may
  only be initialized once per interpreter process

Status in Ceph Dashboard Charm:
  New
Status in ceph package in Ubuntu:
  New
Status in ceph source package in Noble:
  New
Status in ceph source package in Plucky:
  New
Status in ceph source package in Questing:
  New

Bug description:
  Running the noble-caracal (Ceph Squid) test bundle results in failure
  for Charm-Ceph-Dashboard when it tries to perform `set-ssl-
  certificate` with available crts.

  Operation:
  $ sudo ceph dashboard set-ssl-certificate -i /etc/ceph/ceph-dashboard.crt
  Error EIO: Module 'dashboard' has experienced an error and cannot handle commands: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

To manage notifications about this bug go to:
https://bugs.launchpad.net/charm-ceph-dashboard/+bug/2073115/+subscriptions