[Bug 1668123] Re: lxc fails to start with cgroup error

[Dimitri John Ledkov]

Sidenote) the 18GB of /var/lib/juju/db (with backups, of backups, of
backups) was not helpful, I'll need to talk to sosreport people about
that. This is what made the report so huge.

1) It appears that deputy systemd was installed on the machine and subsequently upgraded:
2017-02-12 01:30:24 upgrade systemd:amd64 204-5ubuntu20.22 204-5ubuntu20.24

However, there are no logs available as to what/who/why 20.22 deputy
systemd was installed.

2) Have you tried to use snapd on trusty on that host? Has anything else
tried to do that? (e.g. juju manual provider or some such?!)

3) To recover the system, you should $ apt remove systemd; and reboot.
However that is the workaround

4) Is this nested lxc? or errors inside the instances?
E.g. from logs I see failures to start lxc instances, but I don't see logs for failing to start instances for some reason. 

5) Why was lxc downgraded/upgraded/downgraded multiple times?

6) Are the error messages from this machine? Whilst I do see that
systemd is installed, and dsystemd cgroup is mounted, I am failing to
find the logs for any lxc failures related to starting them.

Is there /var/log/lxc or some such that you could share privately? for
some reason it was not part of the sosreport.

cgmanager should not be interracting with dsystemd.
systemd should not be present on this system (as hwe kernel is not in use, nor is snapd).
lxc should work irrespective of dsystemd.

I will setup trusty, with GA kernel, lxc1, deploy any charm (e.g.
ubuntu), and install deputy systemd to try to reproduce this test case.

I wonder if upstart systemd job should be neutered, unless snapd is
present, and we are booted with hwe kernel.

** Changed in: systemd (Ubuntu)
       Status: Confirmed => Incomplete

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to systemd in Ubuntu.
https://bugs.launchpad.net/bugs/1668123

Title:
  lxc fails to start  with cgroup error

Status in systemd package in Ubuntu:
  Incomplete

Bug description:
  After rebooting a KVM instance hosting LXCs, we get the following
  error:

    $ sudo lxc-ls --fancy
    lxc: cgmanager.c: lxc_cgmanager_escape: 331 call to cgmanager_move_pid_abs_sync(name=dsystemd)  failed: invalid request

  and the LXCs won't start up. In the error logs it showed:

    lxc-start 1487906073.534 ERROR    lxc_cgfs -
  cgfs.c:lxc_cgroupfs_create:873 - Could not find writable mount point
  for cgroup hierarchy 11 while trying to create cgroup.

  The only way I could get the lxcs started was to stop and start
  cgmanager, just a simple restart wasn't sufficient.

  Please let me know if you need any further information.

  $ lsb_release -a
  Description:	Ubuntu 14.04.5 LTS
  Release:	14.04

  $ dpkg-query -W systemd
  systemd	204-5ubuntu20.24

  $ dpkg-query -W cgmanager
  cgmanager	0.24-0ubuntu7.5

  $ dpkg-query -W lxc
  lxc	1.0.9-0ubuntu2

  $ uname -a
  Linux infra 3.13.0-110-generic #157-Ubuntu SMP Mon Feb 20 11:54:05 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1668123/+subscriptions