-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Description
FYI I got pointed to the ZFS project to post this issue here from the systemd issue tracker: systemd/systemd#39062
System information
Type | Version/Name |
---|---|
Distribution Name | Debian |
Distribution Version | 13.1 |
Kernel Version | 6.12.43+deb13-amd64 |
Architecture | x86_64 |
OpenZFS Version | zfs-2.3.2-2, zfs-kmod-2.3.2-2 |
Describe the problem you're observing
The LUKS encrypted partitions are being closed and unmounted after the ZFS pool using them is properly closed.
It appears that Stopping systemd-cryptsetup@storage0_crypt.service - Cryptography Setup for storage0_crypt...
(for example) kicks off a background process to actually close the LUKS volume (as seen by the different PIDs in the log when comparing the log messages of the various FS cleanup steps and the error messages showing that the device is still considered busy).
I also tried various workarounds to change the ordering when things need to be shut down, but no luck so far. These attempts were also made with only shallow knowledge about systemd, based on symptoms from journalctl and trying to understand the dependency tree/shutdown order.
Describe how to reproduce the problem
At least I can reproduce this consistently when simply rebooting or shutting down the system, e.g. running the command reboot
. I suppose someone else needs to create a similar setup with a ZFS pool on top of encrypted LUKS partitions (see the lsblk output).
Include any warning/errors/backtraces from the system logs
lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 7.3T 0 disk
├─sda1 8:1 0 200M 0 part
└─sda2 8:2 0 7.3T 0 part
└─storage2_crypt 253:7 0 7.3T 0 crypt
sdb 8:16 0 7.3T 0 disk
├─sdb1 8:17 0 200M 0 part
└─sdb2 8:18 0 7.3T 0 part
└─storage0_crypt 253:3 0 7.3T 0 crypt
sdc 8:32 0 7.3T 0 disk
├─sdc1 8:33 0 200M 0 part
└─sdc2 8:34 0 7.3T 0 part
└─storage1_crypt 253:5 0 7.3T 0 crypt
sdd 8:48 0 7.3T 0 disk
├─sdd1 8:49 0 200M 0 part
└─sdd2 8:50 0 7.3T 0 part
└─storage4_crypt 253:6 0 7.3T 0 crypt
sde 8:64 0 232.9G 0 disk
├─sde1 8:65 0 487M 0 part
│ └─md1 9:1 0 486M 0 raid1 /boot
└─sde2 8:66 0 232.4G 0 part
└─md0 9:0 0 232.3G 0 raid1
└─md0_crypt 253:0 0 232.3G 0 crypt
├─vg0-root 253:1 0 224G 0 lvm /
└─vg0-swap 253:2 0 8.3G 0 lvm [SWAP]
sdf 8:80 0 7.3T 0 disk
├─sdf1 8:81 0 200M 0 part
└─sdf2 8:82 0 7.3T 0 part
└─storage5_crypt 253:8 0 7.3T 0 crypt
sdg 8:96 0 7.3T 0 disk
├─sdg1 8:97 0 207.9M 0 part
└─sdg2 8:98 0 7.3T 0 part
└─storage3_crypt 253:4 0 7.3T 0 crypt
sdh 8:112 0 232.9G 0 disk
├─sdh1 8:113 0 487M 0 part
│ └─md1 9:1 0 486M 0 raid1 /boot
└─sdh2 8:114 0 232.4G 0 part
└─md0 9:0 0 232.3G 0 raid1
└─md0_crypt 253:0 0 232.3G 0 crypt
├─vg0-root 253:1 0 224G 0 lvm /
└─vg0-swap 253:2 0 8.3G 0 lvm [SWAP]
zpool status
pool: vol0
state: ONLINE
scan: scrub repaired 0B in 1 days 04:47:50 with 0 errors on Mon Sep 15 05:11:52 2025
config:
NAME STATE READ WRITE CKSUM
vol0 ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
storage0_crypt ONLINE 0 0 0
storage1_crypt ONLINE 0 0 0
storage2_crypt ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
storage3_crypt ONLINE 0 0 0
storage4_crypt ONLINE 0 0 0
storage5_crypt ONLINE 0 0 0
errors: No known data errors
journalctl -b -1
Excerpt including the relevant parts with error messages at the end of the log
Sep 16 11:17:45 debianhost systemd[1]: networking.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped networking.service - Raise network interfaces.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target network-pre.target - Preparation for Network.
Sep 16 11:17:45 debianhost systemd[1]: dkms.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped dkms.service - Builds and install new kernel modules through DKMS.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target basic.target - Basic System.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target paths.target - Path Units.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target slices.target - Slice Units.
Sep 16 11:17:45 debianhost systemd[1]: Removed slice user.slice - User and Session Slice.
Sep 16 11:17:45 debianhost systemd[1]: user.slice: Consumed 3.347s CPU time, 355.5M memory peak.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target sockets.target - Socket Units.
Sep 16 11:17:45 debianhost systemd[1]: avahi-daemon.socket: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Closed avahi-daemon.socket - Avahi mDNS/DNS-SD Stack Activation Socket.
Sep 16 11:17:45 debianhost systemd[1]: dbus.socket: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Closed dbus.socket - D-Bus System Message Bus Socket.
Sep 16 11:17:45 debianhost systemd[1]: docker.socket: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Closed docker.socket - Docker Socket for the API.
Sep 16 11:17:45 debianhost systemd[1]: sshd-unix-local.socket: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Closed sshd-unix-local.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local).
Sep 16 11:17:45 debianhost systemd[1]: systemd-hostnamed.socket: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Closed systemd-hostnamed.socket - Hostname Service Socket.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target sysinit.target - System Initialization.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes.
Sep 16 11:17:45 debianhost systemd[1]: systemd-ask-password-console.path: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch.
Sep 16 11:17:45 debianhost systemd[1]: systemd-ask-password-wall.path: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target integritysetup.target - Local Integrity Protected Volumes.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target veritysetup.target - Local Verity Protected Volumes.
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-binfmt.service - Set Up Additional Binary Formats...
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-cryptsetup@md0_crypt.service - Cryptography Setup for md0_crypt...
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-cryptsetup@storage0_crypt.service - Cryptography Setup for storage0_crypt...
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-cryptsetup@storage1_crypt.service - Cryptography Setup for storage1_crypt...
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-cryptsetup@storage2_crypt.service - Cryptography Setup for storage2_crypt...
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-cryptsetup@storage3_crypt.service - Cryptography Setup for storage3_crypt...
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-cryptsetup@storage4_crypt.service - Cryptography Setup for storage4_crypt...
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-cryptsetup@storage5_crypt.service - Cryptography Setup for storage5_crypt...
Sep 16 11:17:45 debianhost systemd[1]: systemd-sysctl.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables.
Sep 16 11:17:45 debianhost systemd[1]: systemd-modules-load.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules.
Sep 16 11:17:45 debianhost systemd[1]: Stopping systemd-timesyncd.service - Network Time Synchronization...
Sep 16 11:17:45 debianhost systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories.
Sep 16 11:17:45 debianhost systemd[1]: systemd-binfmt.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-binfmt.service - Set Up Additional Binary Formats.
Sep 16 11:17:45 debianhost systemd[1]: proc-sys-fs-binfmt_misc.automount: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Unset automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target local-fs.target - Local File Systems.
Sep 16 11:17:45 debianhost systemd-cryptsetup[37351]: Device md0_crypt is still in use.
Sep 16 11:17:45 debianhost systemd-cryptsetup[37351]: Failed to deactivate 'md0_crypt': Device or resource busy
Sep 16 11:17:45 debianhost systemd[1]: Unmounting debianhost\x2dold-home.mount - /debianhost-old/home...
Sep 16 11:17:45 debianhost systemd[1]: Unmounting run-lock.mount - Legacy Locks Directory /run/lock...
Sep 16 11:17:45 debianhost systemd[1]: Unmounting storage-backup.mount - /storage/backup...
Sep 16 11:17:45 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd[1]: Unmounting tmp.mount - Temporary Directory /tmp...
Sep 16 11:17:45 debianhost systemd[1]: zfs-mount.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped zfs-mount.service - Mount ZFS filesystems.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target zfs-import.target - ZFS pool import target.
Sep 16 11:17:45 debianhost systemd[1]: proc-sys-fs-binfmt_misc.mount: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: systemd-cryptsetup@md0_crypt.service: Control process exited, code=exited, status=1/FAILURE
Sep 16 11:17:45 debianhost systemd[1]: systemd-cryptsetup@md0_crypt.service: Failed with result 'exit-code'.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-cryptsetup@md0_crypt.service - Cryptography Setup for md0_crypt.
Sep 16 11:17:45 debianhost systemd[1]: run-lock.mount: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Unmounted run-lock.mount - Legacy Locks Directory /run/lock.
Sep 16 11:17:45 debianhost systemd[1]: systemd-timesyncd.service: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Stopped systemd-timesyncd.service - Network Time Synchronization.
Sep 16 11:17:45 debianhost systemd[1]: tmp.mount: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Unmounted tmp.mount - Temporary Directory /tmp.
Sep 16 11:17:45 debianhost systemd[1]: Stopped target swap.target - Swaps.
Sep 16 11:17:45 debianhost systemd[1]: Deactivating swap dev-disk-by\x2ddiskseq-15.swap - /dev/disk/by-diskseq/15...
Sep 16 11:17:45 debianhost systemd[1]: debianhost\x2dold-home.mount: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Unmounted debianhost\x2dold-home.mount - /debianhost-old/home.
Sep 16 11:17:45 debianhost systemd[1]: Unmounting debianhost\x2dold.mount - /debianhost-old...
Sep 16 11:17:45 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd[1]: debianhost\x2dold.mount: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Unmounted debianhost\x2dold.mount - /debianhost-old.
Sep 16 11:17:45 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd[1]: dev-disk-by\x2ddiskseq-15.swap: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Deactivated swap dev-disk-by\x2ddiskseq-15.swap - /dev/disk/by-diskseq/15.
Sep 16 11:17:45 debianhost systemd[1]: dev-disk-by\x2duuid-a051c99c\x2ddf92\x2d4fa3\x2d87e6\x2d171bd2a4ed2d.swap: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Deactivated swap dev-disk-by\x2duuid-a051c99c\x2ddf92\x2d4fa3\x2d87e6\x2d171bd2a4ed2d.swap - /dev/disk/by-uuid/a051c99c-df92-4fa3-87e6-171bd2a4ed2d.
Sep 16 11:17:45 debianhost systemd[1]: dev-vg0-swap.swap: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Deactivated swap dev-vg0-swap.swap - /dev/vg0/swap.
Sep 16 11:17:45 debianhost systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2dmPFH3crvH8aWowRaU98wpDJpBZGE2KMX1xaXIxR78I45PScJUv5yWKzkPONf1AiV.swap: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Deactivated swap dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2dmPFH3crvH8aWowRaU98wpDJpBZGE2KMX1xaXIxR78I45PScJUv5yWKzkPONf1AiV.swap - /dev/disk/by-id/dm-uuid-LVM-mPFH3crvH8aWowRaU98wpDJpBZGE2KMX1xaXIxR78I45PScJUv5yWKzkPONf1AiV.
Sep 16 11:17:45 debianhost systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dvg0\x2dswap.swap: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Deactivated swap dev-disk-by\x2did-dm\x2dname\x2dvg0\x2dswap.swap - /dev/disk/by-id/dm-name-vg0-swap.
Sep 16 11:17:45 debianhost systemd[1]: dev-dm\x2d2.swap: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Deactivated swap dev-dm\x2d2.swap - /dev/dm-2.
Sep 16 11:17:45 debianhost systemd[1]: dev-mapper-vg0\x2dswap.swap: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Deactivated swap dev-mapper-vg0\x2dswap.swap - /dev/mapper/vg0-swap.
Sep 16 11:17:45 debianhost systemd[1]: Unmounting storage-backup.mount - /storage/backup...
Sep 16 11:17:45 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd[1]: storage-backup.mount: Deactivated successfully.
Sep 16 11:17:45 debianhost systemd[1]: Unmounted storage-backup.mount - /storage/backup.
Sep 16 11:17:45 debianhost systemd[1]: Unmounting storage.mount...
Sep 16 11:17:45 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:45 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd[1]: storage.mount: Deactivated successfully.
Sep 16 11:17:46 debianhost systemd[1]: Unmounted storage.mount.
Sep 16 11:17:46 debianhost systemd[1]: Stopped target local-fs-pre.target - Preparation for Local File Systems.
Sep 16 11:17:46 debianhost systemd[1]: Stopping lvm2-monitor.service - Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
Sep 16 11:17:46 debianhost systemd[1]: systemd-remount-fs.service: Deactivated successfully.
Sep 16 11:17:46 debianhost systemd[1]: Stopped systemd-remount-fs.service - Remount Root and Kernel File Systems.
Sep 16 11:17:46 debianhost systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.
Sep 16 11:17:46 debianhost systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev.
Sep 16 11:17:46 debianhost systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.
Sep 16 11:17:46 debianhost systemd[1]: Stopped systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully.
Sep 16 11:17:46 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost lvm[37389]: 2 logical volume(s) in volume group "vg0" unmonitored
Sep 16 11:17:46 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd[1]: lvm2-monitor.service: Deactivated successfully.
Sep 16 11:17:46 debianhost systemd[1]: Stopped lvm2-monitor.service - Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
Sep 16 11:17:46 debianhost systemd[1]: Reached target shutdown.target - System Shutdown.
Sep 16 11:17:46 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:46 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:47 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:48 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37352]: device-mapper: remove ioctl on storage0_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37352]: Device storage0_crypt is still in use.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37352]: Failed to deactivate 'storage0_crypt': Device or resource busy
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage0_crypt.service: Control process exited, code=exited, status=1/FAILURE
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage0_crypt.service: Failed with result 'exit-code'.
Sep 16 11:17:49 debianhost systemd[1]: Stopped systemd-cryptsetup@storage0_crypt.service - Cryptography Setup for storage0_crypt.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37354]: device-mapper: remove ioctl on storage2_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37354]: Device storage2_crypt is still in use.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37354]: Failed to deactivate 'storage2_crypt': Device or resource busy
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage2_crypt.service: Control process exited, code=exited, status=1/FAILURE
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage2_crypt.service: Failed with result 'exit-code'.
Sep 16 11:17:49 debianhost systemd[1]: Stopped systemd-cryptsetup@storage2_crypt.service - Cryptography Setup for storage2_crypt.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37356]: device-mapper: remove ioctl on storage4_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37356]: Device storage4_crypt is still in use.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37356]: Failed to deactivate 'storage4_crypt': Device or resource busy
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage4_crypt.service: Control process exited, code=exited, status=1/FAILURE
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage4_crypt.service: Failed with result 'exit-code'.
Sep 16 11:17:49 debianhost systemd[1]: Stopped systemd-cryptsetup@storage4_crypt.service - Cryptography Setup for storage4_crypt.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37355]: device-mapper: remove ioctl on storage3_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37355]: Device storage3_crypt is still in use.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37355]: Failed to deactivate 'storage3_crypt': Device or resource busy
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage3_crypt.service: Control process exited, code=exited, status=1/FAILURE
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage3_crypt.service: Failed with result 'exit-code'.
Sep 16 11:17:49 debianhost systemd[1]: Stopped systemd-cryptsetup@storage3_crypt.service - Cryptography Setup for storage3_crypt.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37357]: device-mapper: remove ioctl on storage5_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37357]: Device storage5_crypt is still in use.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37357]: Failed to deactivate 'storage5_crypt': Device or resource busy
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage5_crypt.service: Control process exited, code=exited, status=1/FAILURE
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage5_crypt.service: Failed with result 'exit-code'.
Sep 16 11:17:49 debianhost systemd[1]: Stopped systemd-cryptsetup@storage5_crypt.service - Cryptography Setup for storage5_crypt.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37353]: device-mapper: remove ioctl on storage1_crypt failed: Device or resource busy
Sep 16 11:17:49 debianhost systemd-cryptsetup[37353]: Device storage1_crypt is still in use.
Sep 16 11:17:49 debianhost systemd-cryptsetup[37353]: Failed to deactivate 'storage1_crypt': Device or resource busy
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage1_crypt.service: Control process exited, code=exited, status=1/FAILURE
Sep 16 11:17:49 debianhost systemd[1]: systemd-cryptsetup@storage1_crypt.service: Failed with result 'exit-code'.
Sep 16 11:17:49 debianhost systemd[1]: Stopped systemd-cryptsetup@storage1_crypt.service - Cryptography Setup for storage1_crypt.
Sep 16 11:17:49 debianhost systemd[1]: Reached target umount.target - Unmount All Filesystems.
Sep 16 11:17:49 debianhost systemd[1]: Reached target final.target - Late Shutdown Services.
Sep 16 11:17:49 debianhost systemd[1]: systemd-reboot.service: Deactivated successfully.
Sep 16 11:17:49 debianhost systemd[1]: Finished systemd-reboot.service - System Reboot.
Sep 16 11:17:49 debianhost systemd[1]: Reached target reboot.target - System Reboot.
Sep 16 11:17:49 debianhost systemd[1]: Shutting down.
Sep 16 11:17:50 debianhost systemd[1]: Using hardware watchdog 'iTCO_wdt', version 6, device /dev/watchdog0
Sep 16 11:17:50 debianhost systemd[1]: Watchdog running with a hardware timeout of 10min.
Sep 16 11:17:50 debianhost kernel: watchdog: watchdog0: watchdog did not stop!
Sep 16 11:17:50 debianhost systemd-shutdown[1]: Using hardware watchdog 'iTCO_wdt', version 6, device /dev/watchdog0
Sep 16 11:17:50 debianhost systemd-shutdown[1]: Watchdog running with a hardware timeout of 10min.
Sep 16 11:17:50 debianhost systemd-shutdown[1]: Syncing filesystems and block devices.
Sep 16 11:17:50 debianhost systemd-shutdown[1]: Sending SIGTERM to remaining processes...
Sep 16 11:17:50 debianhost systemd-journald[1377]: Received SIGTERM from PID 1 (systemd-shutdow).
Sep 16 11:17:50 debianhost systemd-journald[1377]: Journal stopped