LXC Container not starting - no init runlevel in container

Written by - 0 comments

Published on - Listed in Linux LXC


In one of my setups I have a LXC host running Ubuntu 14.04 LTS and several LXC containers on it. Most of them are running the same version as the host, Ubuntu 14.04. But two of them run Xenial (16.04). This works when completely removing systemd from the container OS (see Does an Ubuntu 16.04 (xenial) container run on a 14.04 (trusty) host?).

Today I ran apt-get upgrade on the LXC host which also updated the Linux Kernel. As the host runs with Kernel 3.16, I rebooted after the updates. Almost everything worked, but one LXC container (one of the two Xenial containers) didn't start up. Or to be exact: The container started, but inside nothing else would. Using lxc-attach to get into the container there was nothing running, not even the runlevel could be determined:

root@lxchost02:~# lxc-start -n mycontainer -d
root@lxchost02:~# lxc-attach -n mycontainer

root@mycontainer:~# runlevel
unknown

root@mycontainer:~# ps auxf
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root       130  0.3  0.0  21964  4440 ?        S    08:30   0:00 /bin/bash
root       245  0.0  0.0  37368  3228 ?        R+   08:30   0:00  \_ ps auxf
root         1  0.4  0.0  43288  3704 ?        Ss   08:29   0:00 /sbin/init
root         9  0.0  0.0  37484  3112 ?        S    08:29   0:00 mountall --daemon
root       110  0.0  0.0  29952   276 ?        S    08:29   0:00 upstart-udev-bridge --daemon
root       121  0.0  0.0  30020   392 ?        S    08:29   0:00 upstart-socket-bridge --daemon
root       122  0.0  0.0  41592  3068 ?        Ss   08:29   0:00 /lib/systemd/systemd-udevd --daemon

root@mycontainer:~# netstat -lntup
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name

I came across an old mailing list thread (https://lists.ubuntu.com/archives/ubuntu-server-bugs/2014-March/108832.html) which looked very similar to my issue. I tried to run the start in foreground in debug mode like it was done in the thread and got the following output (yep - it's long):

root@lxchost02:~# lxc-start -n mycontainer -l DEBUG -o $(tty) -- /sbin/init --debug --verbose
      lxc-start 1503470991.058 INFO     lxc_start_ui - using rcfile /var/lib/lxc/mycontainer/config
      lxc-start 1503470991.058 WARN     lxc_log - lxc_log_init called with log already initialized
      lxc-start 1503470991.058 INFO     lxc_lsm - LSM security driver AppArmor
      lxc-start 1503470991.058 DEBUG    lxc_conf - allocated pty '/dev/pts/1' (5/6)
      lxc-start 1503470991.058 DEBUG    lxc_conf - allocated pty '/dev/pts/3' (7/8)
      lxc-start 1503470991.058 DEBUG    lxc_conf - allocated pty '/dev/pts/6' (9/10)
      lxc-start 1503470991.058 DEBUG    lxc_conf - allocated pty '/dev/pts/7' (11/12)
      lxc-start 1503470991.058 INFO     lxc_conf - tty's configured
      lxc-start 1503470991.058 DEBUG    lxc_start - sigchild handler set
      lxc-start 1503470991.058 DEBUG    lxc_console - opening /dev/tty for console peer
      lxc-start 1503470991.058 DEBUG    lxc_console - using '/dev/tty' as console
      lxc-start 1503470991.058 DEBUG    lxc_console - 4957 got SIGWINCH fd 17
      lxc-start 1503470991.058 DEBUG    lxc_console - set winsz dstfd:14 cols:158 rows:34
      lxc-start 1503470991.058 INFO     lxc_start - 'mycontainer' is initialized
      lxc-start 1503470991.059 DEBUG    lxc_start - Not dropping cap_sys_boot or watching utmp
      lxc-start 1503470991.059 DEBUG    lxc_conf - instanciated macvlan 'mcB8UF6R', index is '38' and mode '4'
      lxc-start 1503470991.059 INFO     lxc_cgroup - cgroup driver cgmanager initing for mycontainer
      lxc-start 1503470991.062 INFO     lxc_cgmanager - cgroup limits have been setup
      lxc-start 1503470991.088 DEBUG    lxc_conf - move '(null)' to '4965'
      lxc-start 1503470991.088 INFO     lxc_conf - 'mycontainer' hostname has been setup
      lxc-start 1503470991.108 DEBUG    lxc_conf - mac address '00:16:3e:3b:25:d0' on 'eth0' has been setup
      lxc-start 1503470991.108 DEBUG    lxc_conf - 'eth0' has been setup
      lxc-start 1503470991.108 INFO     lxc_conf - network has been setup
      lxc-start 1503470991.109 DEBUG    bdev - trying to mount '/dev/vglxc/mycontainer'->'/usr/lib/x86_64-linux-gnu/lxc' with fstype 'ext3'
      lxc-start 1503470991.109 DEBUG    bdev - mount failed with error: Device or resource busy
      lxc-start 1503470991.109 DEBUG    bdev - trying to mount '/dev/vglxc/mycontainer'->'/usr/lib/x86_64-linux-gnu/lxc' with fstype 'ext2'
      lxc-start 1503470991.109 DEBUG    bdev - mount failed with error: Device or resource busy
      lxc-start 1503470991.109 DEBUG    bdev - trying to mount '/dev/vglxc/mycontainer'->'/usr/lib/x86_64-linux-gnu/lxc' with fstype 'ext4'
      lxc-start 1503470991.109 INFO     bdev - mounted '/dev/vglxc/mycontainer' on '/usr/lib/x86_64-linux-gnu/lxc', with fstype 'ext4'
      lxc-start 1503470991.109 DEBUG    lxc_conf - mounted '/dev/vglxc/mycontainer' on '/usr/lib/x86_64-linux-gnu/lxc'
      lxc-start 1503470991.109 DEBUG    lxc_conf - Set exec command to /sbin/init
      lxc-start 1503470991.109 INFO     lxc_conf - Autodev not required.
      lxc-start 1503470991.109 INFO     lxc_conf - mount points have been setup
      lxc-start 1503470991.109 DEBUG    lxc_conf - mounted 'proc' on '/usr/lib/x86_64-linux-gnu/lxc/proc', type 'proc'
      lxc-start 1503470991.109 DEBUG    lxc_conf - mounted 'sysfs' on '/usr/lib/x86_64-linux-gnu/lxc/sys', type 'sysfs'
      lxc-start 1503470991.109 DEBUG    lxc_conf - remounting /sys/fs/fuse/connections on /usr/lib/x86_64-linux-gnu/lxc/sys/fs/fuse/connections to respect bind or remount options
      lxc-start 1503470991.109 DEBUG    lxc_conf - mounted '/sys/fs/fuse/connections' on '/usr/lib/x86_64-linux-gnu/lxc/sys/fs/fuse/connections', type 'none'
      lxc-start 1503470991.109 DEBUG    lxc_conf - remounting /sys/kernel/debug on /usr/lib/x86_64-linux-gnu/lxc/sys/kernel/debug to respect bind or remount options
      lxc-start 1503470991.109 DEBUG    lxc_conf - mounted '/sys/kernel/debug' on '/usr/lib/x86_64-linux-gnu/lxc/sys/kernel/debug', type 'none'
      lxc-start 1503470991.109 DEBUG    lxc_conf - remounting /sys/kernel/security on /usr/lib/x86_64-linux-gnu/lxc/sys/kernel/security to respect bind or remount options
      lxc-start 1503470991.110 DEBUG    lxc_conf - mounted '/sys/kernel/security' on '/usr/lib/x86_64-linux-gnu/lxc/sys/kernel/security', type 'none'
      lxc-start 1503470991.110 DEBUG    lxc_conf - remounting /sys/fs/pstore on /usr/lib/x86_64-linux-gnu/lxc/sys/fs/pstore to respect bind or remount options
      lxc-start 1503470991.110 DEBUG    lxc_conf - mounted '/sys/fs/pstore' on '/usr/lib/x86_64-linux-gnu/lxc/sys/fs/pstore', type 'none'
      lxc-start 1503470991.110 INFO     lxc_conf - mount points have been setup
      lxc-start 1503470991.110 INFO     lxc_conf - created /usr/lib/x86_64-linux-gnu/lxc/dev/lxc
      lxc-start 1503470991.110 INFO     lxc_conf - console has been setup on lxc/console
      lxc-start 1503470991.110 INFO     lxc_conf - 4 tty(s) has been setup
      lxc-start 1503470991.110 INFO     lxc_conf - I am 1, /proc/self points to '1'
      lxc-start 1503470991.110 DEBUG    lxc_conf - mountpoint for old rootfs is '/usr/lib/x86_64-linux-gnu/lxc/lxc_putold'
      lxc-start 1503470991.110 DEBUG    lxc_conf - pivot_root syscall to '/usr/lib/x86_64-linux-gnu/lxc' successful
      lxc-start 1503470991.119 DEBUG    lxc_conf - umounted '/lxc_putold/dev/pts'
      lxc-start 1503470991.135 DEBUG    lxc_conf - umounted '/lxc_putold/run/lock'
      lxc-start 1503470991.143 DEBUG    lxc_conf - umounted '/lxc_putold/run/shm'
      lxc-start 1503470991.155 DEBUG    lxc_conf - umounted '/lxc_putold/run/user'
      lxc-start 1503470991.163 DEBUG    lxc_conf - umounted '/lxc_putold/sys/fs/cgroup/systemd'
      lxc-start 1503470991.171 DEBUG    lxc_conf - umounted '/lxc_putold/sys/fs/fuse/connections'
      lxc-start 1503470991.179 DEBUG    lxc_conf - umounted '/lxc_putold/sys/kernel/debug'
      lxc-start 1503470991.187 DEBUG    lxc_conf - umounted '/lxc_putold/sys/kernel/security'
      lxc-start 1503470991.199 DEBUG    lxc_conf - umounted '/lxc_putold/sys/fs/pstore'
      lxc-start 1503470991.215 DEBUG    lxc_conf - umounted '/lxc_putold/proc'
      lxc-start 1503470991.227 DEBUG    lxc_conf - umounted '/lxc_putold/tmp'
      lxc-start 1503470991.319 DEBUG    lxc_conf - umounted '/lxc_putold/var/lib/lxc/mycontainer/rootfs'
      lxc-start 1503470991.351 DEBUG    lxc_conf - umounted '/lxc_putold/dev'
      lxc-start 1503470991.363 DEBUG    lxc_conf - umounted '/lxc_putold/run'
      lxc-start 1503470991.383 DEBUG    lxc_conf - umounted '/lxc_putold/sys/fs/cgroup'
      lxc-start 1503470991.395 DEBUG    lxc_conf - umounted '/lxc_putold/var'
      lxc-start 1503470991.407 DEBUG    lxc_conf - umounted '/lxc_putold/sys'
      lxc-start 1503470991.431 DEBUG    lxc_conf - umounted '/lxc_putold'
      lxc-start 1503470991.431 INFO     lxc_conf - created new pts instance
      lxc-start 1503470991.431 INFO     lxc_conf - set personality to '0x0'
      lxc-start 1503470991.431 DEBUG    lxc_conf - drop capability 'sys_module' (16)
      lxc-start 1503470991.431 DEBUG    lxc_conf - drop capability 'mac_admin' (33)
      lxc-start 1503470991.431 DEBUG    lxc_conf - drop capability 'mac_override' (32)
      lxc-start 1503470991.431 DEBUG    lxc_conf - drop capability 'sys_time' (25)
      lxc-start 1503470991.431 DEBUG    lxc_conf - capabilities have been setup
      lxc-start 1503470991.431 NOTICE   lxc_conf - 'mycontainer' is setup.
      lxc-start 1503470991.432 DEBUG    lxc_cgmanager - cgroup 'devices.deny' set to 'a'
      lxc-start 1503470991.432 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c *:* m'
      lxc-start 1503470991.432 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'b *:* m'
      lxc-start 1503470991.432 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 1:3 rwm'
      lxc-start 1503470991.432 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 1:5 rwm'
      lxc-start 1503470991.433 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 5:0 rwm'
      lxc-start 1503470991.433 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 5:1 rwm'
      lxc-start 1503470991.433 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 1:8 rwm'
      lxc-start 1503470991.433 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 1:9 rwm'
      lxc-start 1503470991.433 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 5:2 rwm'
      lxc-start 1503470991.433 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 136:* rwm'
      lxc-start 1503470991.434 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 254:0 rm'
      lxc-start 1503470991.434 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 10:229 rwm'
      lxc-start 1503470991.434 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 10:200 rwm'
      lxc-start 1503470991.434 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 1:7 rwm'
      lxc-start 1503470991.434 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 10:228 rwm'
      lxc-start 1503470991.434 DEBUG    lxc_cgmanager - cgroup 'devices.allow' set to 'c 10:232 rwm'
      lxc-start 1503470991.434 INFO     lxc_cgmanager - cgroup limits have been setup
      lxc-start 1503470991.434 INFO     lxc_apparmor - changed apparmor profile to lxc-container-default
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 4
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 5
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 6
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 7
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 8
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 9
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 10
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 11
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 12
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 14
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 15
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 16
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 17
      lxc-start 1503470991.434 WARN     lxc_start - inherited fd 18
      lxc-start 1503470991.434 NOTICE   lxc_start - exec'ing '/sbin/init'
      lxc-start 1503470991.435 NOTICE   lxc_start - '/sbin/init' started with pid '4965'
      lxc-start 1503470991.435 WARN     lxc_start - invalid pid for SIGCHLD
Loading configuration from /etc/init.conf
Loading configuration from /etc/init
<6>init: Handling startup event
<6>init: mountall goal changed from stop to start
<6>init: mountall state changed from waiting to starting
<6>init: hostname goal changed from stop to start
<6>init: hostname state changed from waiting to starting
<6>init: Handling starting event
<6>init: hwclock goal changed from stop to start
<6>init: hwclock state changed from waiting to starting
<6>init: ureadahead goal changed from stop to start
<6>init: ureadahead state changed from waiting to starting
<6>init: Handling starting event
<6>init: hostname state changed from starting to security-spawning
<6>init: hostname state changed from security-spawning to security
<6>init: hostname state changed from security to pre-starting
<6>init: hostname state changed from pre-starting to pre-start
<6>init: hostname state changed from pre-start to spawning
<6>init: hostname main process (3)
<6>init: hostname state changed from spawning to spawned
<6>init: Handling starting event
<6>init: hwclock.sh goal changed from stop to start
<6>init: hwclock.sh state changed from waiting to starting
<6>init: Handling starting event
<6>init: ureadahead state changed from starting to security-spawning
<6>init: ureadahead state changed from security-spawning to security
<6>init: ureadahead state changed from security to pre-starting
<6>init: ureadahead state changed from pre-starting to pre-start
<6>init: ureadahead state changed from pre-start to spawning
<6>init: ureadahead main process (4)
<6>init: ureadahead state changed from spawning to spawned
<6>init: Handling starting event
<6>init: hwclock.sh state changed from starting to security-spawning
<6>init: hwclock.sh state changed from security-spawning to security
<6>init: hwclock.sh state changed from security to pre-starting
<6>init: hwclock.sh state changed from pre-starting to pre-start
<6>init: hwclock.sh state changed from pre-start to spawning
<6>init: hwclock.sh state changed from spawning to spawned
<6>init: hwclock.sh state changed from spawned to post-starting
<6>init: hwclock.sh state changed from post-starting to post-start
<6>init: hwclock.sh state changed from post-start to running
<6>init: Handling started event
<6>init: hwclock state changed from starting to security-spawning
<6>init: hwclock state changed from security-spawning to security
<6>init: hwclock state changed from security to pre-starting
<6>init: hwclock state changed from pre-starting to pre-start
<6>init: hwclock state changed from pre-start to spawning
<6>init: hwclock main process (5)
<6>init: hwclock state changed from spawning to spawned
<6>init: hostname state changed from spawned to post-starting
<6>init: hostname state changed from post-starting to post-start
<6>init: hostname state changed from post-start to running
<6>init: hostname main process (3) exited normally
<6>init: hostname goal changed from start to stop
<6>init: hostname state changed from running to stopping
<6>init: Handling started event
<6>init: Handling stopping event
<6>init: hostname state changed from stopping to killed
<6>init: hostname state changed from killed to post-stopping
<6>init: hostname state changed from post-stopping to post-stop
<6>init: hostname state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: hostname.sh goal changed from stop to start
<6>init: hostname.sh state changed from waiting to starting
<6>init: Handling starting event
<6>init: hostname.sh state changed from starting to security-spawning
<6>init: hostname.sh state changed from security-spawning to security
<6>init: hostname.sh state changed from security to pre-starting
<6>init: hostname.sh state changed from pre-starting to pre-start
<6>init: hostname.sh state changed from pre-start to spawning
<6>init: hostname.sh state changed from spawning to spawned
<6>init: hostname.sh state changed from spawned to post-starting
<6>init: hostname.sh state changed from post-starting to post-start
<6>init: hostname.sh state changed from post-start to running
<6>init: Handling started event
<6>init: hwclock state changed from spawned to post-starting
<6>init: hwclock state changed from post-starting to post-start
<6>init: hwclock state changed from post-start to running
<6>init: Handling started event
<4>init: hwclock main process (5) terminated with status 77
<6>init: hwclock goal changed from start to stop
<6>init: hwclock state changed from running to stopping
<6>init: Handling stopping event
<6>init: hwclock state changed from stopping to killed
<6>init: hwclock state changed from killed to post-stopping
<6>init: hwclock state changed from post-stopping to post-stop
<6>init: hwclock state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: ureadahead main process (4) exited normally
<6>init: ureadahead goal changed from start to stop
<6>init: ureadahead state changed from spawned to stopping
<6>init: Handling stopping event
<6>init: ureadahead state changed from stopping to killed
<6>init: ureadahead state changed from killed to post-stopping
<6>init: ureadahead state changed from post-stopping to post-stop
<6>init: ureadahead state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: mountall state changed from starting to security-spawning
<6>init: mountall state changed from security-spawning to security
<6>init: mountall state changed from security to pre-starting
<6>init: mountall state changed from pre-starting to pre-start
<6>init: mountall state changed from pre-start to spawning
<6>init: mountall main process (7)
<6>init: mountall state changed from spawning to spawned
<6>init: Handling starting/failed event
<6>init: mountall main process (7) executable changed
<6>init: Connection from private client
<6>init: mountall main process (7) became new process (8)
<6>init: mountall main process (8) became new process (9)
<6>init: mountall state changed from spawned to post-starting
<6>init: mountall state changed from post-starting to post-start
<6>init: mountall state changed from post-start to running
<6>init: Handling started event
<6>init: Handling mounted event
<6>init: checkroot.sh goal changed from stop to start
<6>init: checkroot.sh state changed from waiting to starting
<6>init: checkfs.sh goal changed from stop to start
<6>init: checkfs.sh state changed from waiting to starting
<6>init: checkroot-bootclean.sh goal changed from stop to start
<6>init: checkroot-bootclean.sh state changed from waiting to starting
<6>init: Handling mounted event
<6>init: mounted-proc goal changed from stop to start
<6>init: mounted-proc state changed from waiting to starting
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: mounted-debugfs goal changed from stop to start
<6>init: mounted-debugfs state changed from waiting to starting
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: Handling starting event
<6>init: checkroot.sh state changed from starting to security-spawning
<6>init: checkroot.sh state changed from security-spawning to security
<6>init: checkroot.sh state changed from security to pre-starting
<6>init: checkroot.sh state changed from pre-starting to pre-start
<6>init: checkroot.sh state changed from pre-start to spawning
<6>init: checkroot.sh state changed from spawning to spawned
<6>init: checkroot.sh state changed from spawned to post-starting
<6>init: checkroot.sh state changed from post-starting to post-start
<6>init: checkroot.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: checkfs.sh state changed from starting to security-spawning
<6>init: checkfs.sh state changed from security-spawning to security
<6>init: checkfs.sh state changed from security to pre-starting
<6>init: checkfs.sh state changed from pre-starting to pre-start
<6>init: checkfs.sh state changed from pre-start to spawning
<6>init: checkfs.sh state changed from spawning to spawned
<6>init: checkfs.sh state changed from spawned to post-starting
<6>init: checkfs.sh state changed from post-starting to post-start
<6>init: checkfs.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: checkroot-bootclean.sh state changed from starting to security-spawning
<6>init: checkroot-bootclean.sh state changed from security-spawning to security
<6>init: checkroot-bootclean.sh state changed from security to pre-starting
<6>init: checkroot-bootclean.sh state changed from pre-starting to pre-start
<6>init: checkroot-bootclean.sh state changed from pre-start to spawning
<6>init: checkroot-bootclean.sh state changed from spawning to spawned
<6>init: checkroot-bootclean.sh state changed from spawned to post-starting
<6>init: checkroot-bootclean.sh state changed from post-starting to post-start
<6>init: checkroot-bootclean.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: mounted-proc state changed from starting to security-spawning
<6>init: mounted-proc state changed from security-spawning to security
<6>init: mounted-proc state changed from security to pre-starting
<6>init: mounted-proc state changed from pre-starting to pre-start
<6>init: mounted-proc state changed from pre-start to spawning
<6>init: mounted-proc main process (10)
<6>init: mounted-proc state changed from spawning to spawned
<6>init: Handling starting event
<6>init: mounted-debugfs state changed from starting to security-spawning
<6>init: mounted-debugfs state changed from security-spawning to security
<6>init: mounted-debugfs state changed from security to pre-starting
<6>init: mounted-debugfs state changed from pre-starting to pre-start
<6>init: mounted-debugfs state changed from pre-start to spawning
<6>init: mounted-debugfs main process (11)
<6>init: mounted-debugfs state changed from spawning to spawned
<6>init: Handling started event
<6>init: Handling started event
<6>init: Handling started event
<6>init: mounted-proc state changed from spawned to post-starting
<6>init: mounted-proc state changed from post-starting to post-start
<6>init: mounted-proc state changed from post-start to running
<6>init: mounted-debugfs state changed from spawned to post-starting
<6>init: mounted-debugfs state changed from post-starting to post-start
<6>init: mounted-debugfs state changed from post-start to running
<6>init: Handling mounted event
<6>init: Handling mountallServer event
<6>init: Handling started event
<6>init: Handling started event
<6>init: Handling mounting event
<6>init: Handling mounting event
<6>init: Handling mounting event
<6>init: mounted-debugfs main process (11) exited normally
<6>init: mounted-debugfs goal changed from start to stop
<6>init: mounted-debugfs state changed from running to stopping
<6>init: Handling stopping event
<6>init: mounted-debugfs state changed from stopping to killed
<6>init: mounted-debugfs state changed from killed to post-stopping
<6>init: mounted-debugfs state changed from post-stopping to post-stop
<6>init: mounted-debugfs state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: mounted-proc main process (10) exited normally
<6>init: mounted-proc goal changed from start to stop
<6>init: mounted-proc state changed from running to stopping
<6>init: Handling stopping event
<6>init: mounted-proc state changed from stopping to killed
<6>init: mounted-proc state changed from killed to post-stopping
<6>init: mounted-proc state changed from post-stopping to post-stop
<6>init: mounted-proc state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: Handling all-swaps event
<6>init: Handling mounted event
<6>init: Handling mounted event
<6>init: mounted-tmp goal changed from stop to start
<6>init: mounted-tmp state changed from waiting to starting
<6>init: Handling starting event
<6>init: mounted-tmp state changed from starting to security-spawning
<6>init: mounted-tmp state changed from security-spawning to security
<6>init: mounted-tmp state changed from security to pre-starting
<6>init: mounted-tmp state changed from pre-starting to pre-start
<6>init: mounted-tmp state changed from pre-start to spawning
<6>init: mounted-tmp main process (16)
<6>init: mounted-tmp state changed from spawning to spawned
<6>init: mounted-tmp state changed from spawned to post-starting
<6>init: mounted-tmp state changed from post-starting to post-start
<6>init: mounted-tmp state changed from post-start to running
<6>init: Handling started event
<6>init: Handling mounted event
<6>init: resolvconf goal changed from stop to start
<6>init: resolvconf state changed from waiting to starting
<6>init: mounted-run goal changed from stop to start
<6>init: mounted-run state changed from waiting to starting
<6>init: container-detect goal changed from stop to start
<6>init: container-detect state changed from waiting to starting
<6>init: Handling starting event
<6>init: resolvconf state changed from starting to security-spawning
<6>init: resolvconf state changed from security-spawning to security
<6>init: resolvconf state changed from security to pre-starting
<6>init: resolvconf pre-start process (18)
<6>init: resolvconf state changed from pre-starting to pre-start
<6>init: Handling starting event
<6>init: mounted-run state changed from starting to security-spawning
<6>init: mounted-run state changed from security-spawning to security
<6>init: mounted-run state changed from security to pre-starting
<6>init: mounted-run state changed from pre-starting to pre-start
<6>init: mounted-run state changed from pre-start to spawning
<6>init: mounted-run main process (20)
<6>init: mounted-run state changed from spawning to spawned
<6>init: Handling starting event
<6>init: container-detect state changed from starting to security-spawning
<6>init: container-detect state changed from security-spawning to security
<6>init: container-detect state changed from security to pre-starting
<6>init: container-detect pre-start process (21)
<6>init: container-detect state changed from pre-starting to pre-start
<6>init: mounted-run state changed from spawned to post-starting
<6>init: mounted-run state changed from post-starting to post-start
<6>init: mounted-run state changed from post-start to running
<6>init: Handling started event
<6>init: Handling mounting event
<6>init: Handling mounting event
<6>init: Handling mounting event
<6>init: Handling mounted event
<6>init: mounted-run main process (20) exited normally
<6>init: mounted-run goal changed from start to stop
<6>init: mounted-run state changed from running to stopping
<6>init: Handling stopping event
<6>init: mounted-run state changed from stopping to killed
<6>init: mounted-run state changed from killed to post-stopping
<6>init: mounted-run state changed from post-stopping to post-stop
<6>init: mounted-run state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: Connection from private client
<6>init: Handling container event
<6>init: network-interface-container goal changed from stop to start
<6>init: network-interface-container state changed from waiting to starting
<6>init: Handling starting event
<6>init: network-interface-container state changed from starting to security-spawning
<6>init: network-interface-container state changed from security-spawning to security
<6>init: network-interface-container state changed from security to pre-starting
<6>init: network-interface-container state changed from pre-starting to pre-start
<6>init: network-interface-container state changed from pre-start to spawning
<6>init: network-interface-container main process (33)
<6>init: network-interface-container state changed from spawning to spawned
<6>init: container-detect pre-start process (21) exited normally
<6>init: container-detect state changed from pre-start to spawning
<6>init: container-detect state changed from spawning to spawned
<6>init: container-detect state changed from spawned to post-starting
<6>init: container-detect state changed from post-starting to post-start
<6>init: container-detect state changed from post-start to running
<6>init: Handling started event
<6>init: network-interface-container state changed from spawned to post-starting
<6>init: network-interface-container state changed from post-starting to post-start
<6>init: network-interface-container state changed from post-start to running
<6>init: Handling started event
<6>init: Handling mounted event
<6>init: Connection from private client
<6>init: Handling net-device-added event
<6>init: network-interface (lo) goal changed from stop to start
<6>init: network-interface (lo) state changed from waiting to starting
<6>init: Handling starting event
<6>init: network-interface-security (network-interface/lo) goal changed from stop to start
<6>init: network-interface-security (network-interface/lo) state changed from waiting to starting
<6>init: Handling starting event
<6>init: network-interface-security (network-interface/lo) state changed from starting to security-spawning
<6>init: network-interface-security (network-interface/lo) state changed from security-spawning to security
<6>init: network-interface-security (network-interface/lo) state changed from security to pre-starting
<6>init: network-interface-security (network-interface/lo) pre-start process (40)
<6>init: network-interface-security (network-interface/lo) state changed from pre-starting to pre-start
<6>init: Handling mounted event
<6>init: network-interface-container main process (33) exited normally
<6>init: network-interface-container goal changed from start to stop
<6>init: network-interface-container state changed from running to stopping
<6>init: Handling stopping event
<6>init: network-interface-container state changed from stopping to killed
<6>init: network-interface-container state changed from killed to post-stopping
<6>init: network-interface-container state changed from post-stopping to post-stop
<6>init: network-interface-container state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: network-interface-security (network-interface/lo) pre-start process (40) exited normally
<6>init: network-interface-security (network-interface/lo) state changed from pre-start to spawning
<6>init: network-interface-security (network-interface/lo) state changed from spawning to spawned
<6>init: network-interface-security (network-interface/lo) state changed from spawned to post-starting
<6>init: network-interface-security (network-interface/lo) state changed from post-starting to post-start
<6>init: network-interface-security (network-interface/lo) state changed from post-start to running
<6>init: mounted-tmp main process (16) exited normally
<6>init: mounted-tmp goal changed from start to stop
<6>init: mounted-tmp state changed from running to stopping
<6>init: network-interface (lo) state changed from starting to security-spawning
<6>init: network-interface (lo) state changed from security-spawning to security
<6>init: network-interface (lo) state changed from security to pre-starting
<6>init: network-interface (lo) pre-start process (48)
<6>init: network-interface (lo) state changed from pre-starting to pre-start
<6>init: Handling started event
<6>init: Handling stopping event
<6>init: mounted-tmp state changed from stopping to killed
<6>init: mounted-tmp state changed from killed to post-stopping
<6>init: mounted-tmp state changed from post-stopping to post-stop
<6>init: mounted-tmp state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: Connection from private client
<6>init: Handling net-device-up event
<6>init: mountall-net goal changed from stop to start
<6>init: mountall-net state changed from waiting to starting
<6>init: upstart-socket-bridge goal changed from stop to start
<6>init: upstart-socket-bridge state changed from waiting to starting
<6>init: Handling starting event
<6>init: mountall-net state changed from starting to security-spawning
<6>init: mountall-net state changed from security-spawning to security
<6>init: mountall-net state changed from security to pre-starting
<6>init: mountall-net state changed from pre-starting to pre-start
<6>init: mountall-net state changed from pre-start to spawning
<6>init: mountall-net main process (55)
<6>init: mountall-net state changed from spawning to spawned
<6>init: Handling starting event
<6>init: upstart-socket-bridge state changed from starting to security-spawning
<6>init: upstart-socket-bridge state changed from security-spawning to security
<6>init: upstart-socket-bridge state changed from security to pre-starting
<6>init: upstart-socket-bridge state changed from pre-starting to pre-start
<6>init: upstart-socket-bridge state changed from pre-start to spawning
<6>init: upstart-socket-bridge main process (57)
<6>init: upstart-socket-bridge state changed from spawning to spawned
<6>init: mountall-net state changed from spawned to post-starting
<6>init: mountall-net state changed from post-starting to post-start
<6>init: mountall-net state changed from post-start to running
<6>init: Handling started event
<6>init: Connection from private client
<6>init: Connection from private client
<6>init: mountall-net main process (55) exited normally
<6>init: mountall-net goal changed from start to stop
<6>init: mountall-net state changed from running to stopping
<6>init: Handling stopping event
<6>init: mountall-net state changed from stopping to killed
<6>init: mountall-net state changed from killed to post-stopping
<6>init: mountall-net state changed from post-stopping to post-stop
<6>init: mountall-net state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: resolvconf pre-start process (18) exited normally
<6>init: resolvconf state changed from pre-start to spawning
<6>init: resolvconf state changed from spawning to spawned
<6>init: resolvconf state changed from spawned to post-starting
<6>init: resolvconf state changed from post-starting to post-start
<6>init: resolvconf state changed from post-start to running
<6>init: Handling started event
<6>init: Handling virtual-filesystems event
<6>init: mountnfs-bootclean.sh goal changed from stop to start
<6>init: mountnfs-bootclean.sh state changed from waiting to starting
<6>init: udev goal changed from stop to start
<6>init: udev state changed from waiting to starting
<6>init: console-setup goal changed from stop to start
<6>init: console-setup state changed from waiting to starting
<6>init: procps-instance (virtual-filesystems) goal changed from stop to start
<6>init: procps-instance (virtual-filesystems) state changed from waiting to starting
<6>init: mountkernfs.sh goal changed from stop to start
<6>init: mountkernfs.sh state changed from waiting to starting
<6>init: bootmisc.sh goal changed from stop to start
<6>init: bootmisc.sh state changed from waiting to starting
<6>init: mountdevsubfs.sh goal changed from stop to start
<6>init: mountdevsubfs.sh state changed from waiting to starting
<6>init: mtab.sh goal changed from stop to start
<6>init: mtab.sh state changed from waiting to starting
<6>init: mountall-bootclean.sh goal changed from stop to start
<6>init: mountall-bootclean.sh state changed from waiting to starting
<6>init: Handling starting event
<6>init: mountnfs-bootclean.sh state changed from starting to security-spawning
<6>init: mountnfs-bootclean.sh state changed from security-spawning to security
<6>init: mountnfs-bootclean.sh state changed from security to pre-starting
<6>init: mountnfs-bootclean.sh state changed from pre-starting to pre-start
<6>init: mountnfs-bootclean.sh state changed from pre-start to spawning
<6>init: mountnfs-bootclean.sh state changed from spawning to spawned
<6>init: mountnfs-bootclean.sh state changed from spawned to post-starting
<6>init: mountnfs-bootclean.sh state changed from post-starting to post-start
<6>init: mountnfs-bootclean.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: upstart-udev-bridge goal changed from stop to start
<6>init: upstart-udev-bridge state changed from waiting to starting
<6>init: Handling starting event
<6>init: console-setup state changed from starting to security-spawning
<6>init: console-setup state changed from security-spawning to security
<6>init: console-setup state changed from security to pre-starting
<6>init: console-setup state changed from pre-starting to pre-start
<6>init: console-setup state changed from pre-start to spawning
<6>init: console-setup main process (84)
<6>init: console-setup state changed from spawning to spawned
<6>init: Handling starting event
<6>init: procps-instance (virtual-filesystems) state changed from starting to security-spawning
<6>init: procps-instance (virtual-filesystems) state changed from security-spawning to security
<6>init: procps-instance (virtual-filesystems) state changed from security to pre-starting
<6>init: procps-instance (virtual-filesystems) state changed from pre-starting to pre-start
<6>init: procps-instance (virtual-filesystems) state changed from pre-start to spawning
<6>init: procps-instance (virtual-filesystems) main process (87)
<6>init: procps-instance (virtual-filesystems) state changed from spawning to spawned
<6>init: Handling starting event
<6>init: mountkernfs.sh state changed from starting to security-spawning
<6>init: mountkernfs.sh state changed from security-spawning to security
<6>init: mountkernfs.sh state changed from security to pre-starting
<6>init: mountkernfs.sh state changed from pre-starting to pre-start
<6>init: mountkernfs.sh state changed from pre-start to spawning
<6>init: mountkernfs.sh state changed from spawning to spawned
<6>init: mountkernfs.sh state changed from spawned to post-starting
<6>init: mountkernfs.sh state changed from post-starting to post-start
<6>init: mountkernfs.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: bootmisc.sh state changed from starting to security-spawning
<6>init: bootmisc.sh state changed from security-spawning to security
<6>init: bootmisc.sh state changed from security to pre-starting
<6>init: bootmisc.sh state changed from pre-starting to pre-start
<6>init: bootmisc.sh state changed from pre-start to spawning
<6>init: bootmisc.sh state changed from spawning to spawned
<6>init: bootmisc.sh state changed from spawned to post-starting
<6>init: bootmisc.sh state changed from post-starting to post-start
<6>init: bootmisc.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: mountdevsubfs.sh state changed from starting to security-spawning
<6>init: mountdevsubfs.sh state changed from security-spawning to security
<6>init: mountdevsubfs.sh state changed from security to pre-starting
<6>init: mountdevsubfs.sh state changed from pre-starting to pre-start
<6>init: mountdevsubfs.sh state changed from pre-start to spawning
<6>init: mountdevsubfs.sh state changed from spawning to spawned
<6>init: mountdevsubfs.sh state changed from spawned to post-starting
<6>init: mountdevsubfs.sh state changed from post-starting to post-start
<6>init: mountdevsubfs.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: mtab.sh state changed from starting to security-spawning
<6>init: mtab.sh state changed from security-spawning to security
<6>init: mtab.sh state changed from security to pre-starting
<6>init: mtab.sh state changed from pre-starting to pre-start
<6>init: mtab.sh state changed from pre-start to spawning
<6>init: mtab.sh state changed from spawning to spawned
<6>init: mtab.sh state changed from spawned to post-starting
<6>init: mtab.sh state changed from post-starting to post-start
<6>init: mtab.sh state changed from post-start to running
<6>init: Handling starting event
<6>init: mountall-bootclean.sh state changed from starting to security-spawning
<6>init: mountall-bootclean.sh state changed from security-spawning to security
<6>init: mountall-bootclean.sh state changed from security to pre-starting
<6>init: mountall-bootclean.sh state changed from pre-starting to pre-start
<6>init: mountall-bootclean.sh state changed from pre-start to spawning
<6>init: mountall-bootclean.sh state changed from spawning to spawned
<6>init: mountall-bootclean.sh state changed from spawned to post-starting
<6>init: mountall-bootclean.sh state changed from post-starting to post-start
<6>init: mountall-bootclean.sh state changed from post-start to running
<6>init: Handling started event
<6>init: Handling starting event
<6>init: upstart-udev-bridge state changed from starting to security-spawning
<6>init: upstart-udev-bridge state changed from security-spawning to security
<6>init: upstart-udev-bridge state changed from security to pre-starting
<6>init: upstart-udev-bridge state changed from pre-starting to pre-start
<6>init: upstart-udev-bridge state changed from pre-start to spawning
<6>init: upstart-udev-bridge main process (91)
<6>init: upstart-udev-bridge state changed from spawning to spawned
<6>init: Handling started event
<6>init: Handling started event
<6>init: Handling started event
<6>init: Handling started event
<6>init: Handling started event
<6>init: console-setup state changed from spawned to post-starting
<6>init: console-setup state changed from post-starting to post-start
<6>init: console-setup state changed from post-start to running
<6>init: procps-instance (virtual-filesystems) state changed from spawned to post-starting
<6>init: procps-instance (virtual-filesystems) state changed from post-starting to post-start
<6>init: procps-instance (virtual-filesystems) state changed from post-start to running
<4>init: console-setup main process (84) terminated with status 1
<6>init: console-setup goal changed from start to stop
<6>init: console-setup state changed from running to stopping
<6>init: Handling started event
<6>init: Handling started event
<6>init: procps goal changed from stop to start
<6>init: procps state changed from waiting to starting
<6>init: Handling stopping event
<6>init: console-setup state changed from stopping to killed
<6>init: console-setup state changed from killed to post-stopping
<6>init: console-setup state changed from post-stopping to post-stop
<6>init: console-setup state changed from post-stop to waiting
<6>init: Handling starting event
<6>init: procps state changed from starting to security-spawning
<6>init: procps state changed from security-spawning to security
<6>init: procps state changed from security to pre-starting
<6>init: procps state changed from pre-starting to pre-start
<6>init: procps state changed from pre-start to spawning
<6>init: procps state changed from spawning to spawned
<6>init: procps state changed from spawned to post-starting
<6>init: procps state changed from post-starting to post-start
<6>init: procps state changed from post-start to running
<6>init: Handling stopped event
<6>init: Handling started event
<6>init: Connection from private client
<6>init: procps-instance (virtual-filesystems) main process (87) exited normally
<6>init: procps-instance (virtual-filesystems) goal changed from start to stop
<6>init: procps-instance (virtual-filesystems) state changed from running to stopping
<6>init: upstart-udev-bridge main process (91) became new process (95)
<6>init: Handling remote-filesystems event
<6>init: mountnfs.sh goal changed from stop to start
<6>init: mountnfs.sh state changed from waiting to starting
<6>init: Handling stopping event
<6>init: procps-instance (virtual-filesystems) state changed from stopping to killed
<6>init: procps-instance (virtual-filesystems) state changed from killed to post-stopping
<6>init: procps-instance (virtual-filesystems) state changed from post-stopping to post-stop
<6>init: procps-instance (virtual-filesystems) state changed from post-stop to waiting
<6>init: Handling starting event
<6>init: mountnfs.sh state changed from starting to security-spawning
<6>init: mountnfs.sh state changed from security-spawning to security
<6>init: mountnfs.sh state changed from security to pre-starting
<6>init: mountnfs.sh state changed from pre-starting to pre-start
<6>init: mountnfs.sh state changed from pre-start to spawning
<6>init: mountnfs.sh state changed from spawning to spawned
<6>init: mountnfs.sh state changed from spawned to post-starting
<6>init: mountnfs.sh state changed from post-starting to post-start
<6>init: mountnfs.sh state changed from post-start to running
<6>init: Handling stopped event
<6>init: Handling started event
<6>init: upstart-udev-bridge main process (95) became new process (97)
<6>init: upstart-udev-bridge state changed from spawned to post-starting
<6>init: upstart-udev-bridge state changed from post-starting to post-start
<6>init: upstart-udev-bridge state changed from post-start to running
<6>init: udev state changed from starting to security-spawning
<6>init: udev state changed from security-spawning to security
<6>init: udev state changed from security to pre-starting
<6>init: udev state changed from pre-starting to pre-start
<6>init: udev state changed from pre-start to spawning
<6>init: udev main process (101)
<6>init: udev state changed from spawning to spawned
<6>init: Handling started event
<6>init: udev main process (101) became new process (104)
<6>init: udev state changed from spawned to post-starting
<6>init: udev state changed from post-starting to post-start
<6>init: udev state changed from post-start to running
<6>init: Handling started event
<6>init: kmod goal changed from stop to start
<6>init: kmod state changed from waiting to starting
<6>init: Handling virtual-filesystems/failed event
<6>init: Handling starting event
<6>init: kmod state changed from starting to security-spawning
<6>init: kmod state changed from security-spawning to security
<6>init: kmod state changed from security to pre-starting
<6>init: kmod state changed from pre-starting to pre-start
<6>init: kmod state changed from pre-start to spawning
<6>init: kmod main process (106)
<6>init: kmod state changed from spawning to spawned
<6>init: kmod state changed from spawned to post-starting
<6>init: kmod state changed from post-starting to post-start
<6>init: kmod state changed from post-start to running
<6>init: Handling started event
<6>init: kmod main process (106) exited normally
<6>init: kmod goal changed from start to stop
<6>init: kmod state changed from running to stopping
<6>init: Handling stopping event
<6>init: kmod state changed from stopping to killed
<6>init: kmod state changed from killed to post-stopping
<6>init: kmod state changed from post-stopping to post-stop
<6>init: kmod state changed from post-stop to waiting
<6>init: Handling stopped event
<6>init: Connection from private client
<6>init: upstart-socket-bridge main process (57) became new process (123)
<6>init: upstart-socket-bridge main process (123) became new process (124)
<6>init: upstart-socket-bridge state changed from spawned to post-starting
<6>init: upstart-socket-bridge state changed from post-starting to post-start
<6>init: upstart-socket-bridge state changed from post-start to running
<6>init: Handling started event
<6>init: Connection from private client
<6>init: Handling static-network-up event
<6>init: procps-instance (static-network-up) goal changed from stop to start
<6>init: procps-instance (static-network-up) state changed from waiting to starting
<6>init: Handling starting event
<6>init: procps-instance (static-network-up) state changed from starting to security-spawning
<6>init: procps-instance (static-network-up) state changed from security-spawning to security
<6>init: procps-instance (static-network-up) state changed from security to pre-starting
<6>init: procps-instance (static-network-up) state changed from pre-starting to pre-start
<6>init: procps-instance (static-network-up) state changed from pre-start to spawning
<6>init: procps-instance (static-network-up) main process (127)
<6>init: procps-instance (static-network-up) state changed from spawning to spawned
<6>init: network-interface (lo) pre-start process (48) exited normally
<6>init: network-interface (lo) state changed from pre-start to spawning
<6>init: network-interface (lo) state changed from spawning to spawned
<6>init: network-interface (lo) state changed from spawned to post-starting
<6>init: network-interface (lo) state changed from post-starting to post-start
<6>init: network-interface (lo) state changed from post-start to running
<6>init: Handling started event
<6>init: procps-instance (static-network-up) state changed from spawned to post-starting
<6>init: procps-instance (static-network-up) state changed from post-starting to post-start
<6>init: procps-instance (static-network-up) state changed from post-start to running
<6>init: Handling started event
<6>init: procps-instance (static-network-up) main process (127) exited normally
<6>init: procps-instance (static-network-up) goal changed from start to stop
<6>init: procps-instance (static-network-up) state changed from running to stopping
<6>init: Handling stopping event
<6>init: procps-instance (static-network-up) state changed from stopping to killed
<6>init: procps-instance (static-network-up) state changed from killed to post-stopping
<6>init: procps-instance (static-network-up) state changed from post-stopping to post-stop
<6>init: procps-instance (static-network-up) state changed from post-stop to waiting
<6>init: Handling stopped event
      lxc-start 1503470999.451 DEBUG    lxc_commands - peer has disconnected
      lxc-start 1503470999.451 DEBUG    lxc_commands - peer has disconnected
      lxc-start 1503470999.452 DEBUG    lxc_commands - peer has disconnected
      lxc-start 1503470999.452 DEBUG    lxc_commands - peer has disconnected
      lxc-start 1503470999.452 DEBUG    lxc_commands - peer has disconnected
      lxc-start 1503470999.452 DEBUG    lxc_commands - peer has disconnected
      lxc-start 1503470999.452 DEBUG    lxc_commands - peer has disconnected
      lxc-start 1503470999.452 DEBUG    lxc_commands - peer has disconnected

Unfortunately no error jumped into my eye where I could blame something. At first I thought the update maybe broke some compatibility between the Trusty LXC host and the Xenial LXC container, but remember, there are two Xenial containers running. The other one didn't have any startup issues.

So I created a whole new Xenial container from scratch and then started to copy data from mycontainer into this new Xenial container (mycontainer2). As soon as I rsynced "/etc", the new Xenial container would fail with the same problem. Eventually I figured out that as soon as I rsynced /etc/fstab from mycontainer into mycontainer2 it would not start anymore. So the problem must be /etc/fstab inside the container:

root@lxchost02:~# cat /var/lib/lxc/mycontainer/rootfs/etc/fstab
# UNCONFIGURED FSTAB FOR BASE SYSTEM
/dev/vglxc/container01 /var/lib/lxc/container01/rootfs ext4 defaults 0 0
/dev/vglxc/mycontainer /var/lib/lxc/mycontainer/rootfs ext4 defaults 0 0

What the hell?! Why are there any fstab entries in the first point? A container shouldn't have this inside its OS but rather on the LXC host. Comparing with the working Xenial container:

root@lxchost02:~# cat /var/lib/lxc/xenialcontainer/rootfs/etc/fstab
# UNCONFIGURED FSTAB FOR BASE SYSTEM

That's right, it should be empty.

Besides that, the first fstab entry, mentioning /dev/vglxc/container01, was completely wrong as this container isn't even running on the same LXC host.

Once I removed the fstab entries inside the container OS, mycontainer started correctly again.

root@lxchost02:~# lxc-start -n mycontainer -d
root@lxchost02:~# lxc-attach -n mycontainer
root@mycontainer:~# netstat -lntup
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      351/sshd       
tcp        0      0 127.0.0.1:5432          0.0.0.0:*               LISTEN      867/postgres   
tcp        0      0 0.0.0.0:5666            0.0.0.0:*               LISTEN      679/nrpe       
tcp6       0      0 :::22                   :::*                    LISTEN      351/sshd       
tcp6       0      0 :::8090                 :::*                    LISTEN      402/java       
tcp6       0      0 :::5666                 :::*                    LISTEN      679/nrpe       
tcp6       0      0 :::3306                 :::*                    LISTEN      607/mysqld     

To sum it up: The start issue was definitely caused by the /etc/fstab inside mycontainer. However I still don't know how these entries got in there.


Add a comment

Show form to leave a comment

Comments (newest first)

No comments yet.

RSS feed

Blog Tags:

  AWS   Android   Ansible   Apache   Apple   Atlassian   BSD   Backup   Bash   Bluecoat   CMS   Chef   Cloud   Coding   Consul   Containers   CouchDB   DB   DNS   Database   Databases   Docker   ELK   Elasticsearch   Filebeat   FreeBSD   Galera   Git   GlusterFS   Grafana   Graphics   HAProxy   HTML   Hacks   Hardware   Icinga   Influx   Internet   Java   KVM   Kibana   Kodi   Kubernetes   LVM   LXC   Linux   Logstash   Mac   Macintosh   Mail   MariaDB   Minio   MongoDB   Monitoring   Multimedia   MySQL   NFS   Nagios   Network   Nginx   OSSEC   OTRS   Office   PGSQL   PHP   Perl   Personal   PostgreSQL   Postgres   PowerDNS   Proxmox   Proxy   Python   Rancher   Rant   Redis   Roundcube   SSL   Samba   Seafile   Security   Shell   SmartOS   Solaris   Surveillance   Systemd   TLS   Tomcat   Ubuntu   Unix   VMWare   VMware   Varnish   Virtualization   Windows   Wireless   Wordpress   Wyse   ZFS   Zoneminder