Symptom

Conditions

Rootfs Diskspace is full on Standbyrp

Workaround

Clear rootfs diskspace on Standbyrp

Further Problem Description

1. Filled rootfs of standby RP (0/RP1/CPU0) upto 92% 2. Tried install replace without force ? as expected it is failed. 3. Tried install replace force ? this is also failing. Show tech: /ws/vmusalir-bgl/showtech_logs/showtech-R1-install-2021-Jun-10.195728.UTC.tgz Platform: Spitfire Version: 7.5.1.07I -Out------2021-06-11T02-41-59[MainThread][R1:vty]> attach location 0/RP1/CPU0 Thu Jun 10 16:57:48.890 UTC Last login: Thu Jun 10 16:52:57 2021 from 172.0.30.1 export PS1='#' [node0_RP1_CPU0:~]$export PS1='#' # # lvs --units m WARNING: Failed to connect to lvmetad. Falling back to device scanning. LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert boot-lv main-xr-vg -wi-ao---- 956.00m install-data-disk1 main-xr-vg Vwi-aotz-- 62632.00m install-data-thinpool 77.14 install-data-docker main-xr-vg Vwi-aotz-- 6960.00m install-data-thinpool 1.66 install-data-encrypted_in main-xr-vg Vwi-aotz-- 4.00m install-data-thinpool 4.69 install-data-log main-xr-vg Vwi-aotz-- 5568.00m install-data-thinpool 8.02 install-data-scratch main-xr-vg Vwi-aotz-- 4032.00m install-data-thinpool 1.64 install-data-thinpool main-xr-vg twi-aotz-- 79200.00m 61.80 30.12 install-rootfs-snapshot-1623278009 main-xr-vg Vwi-aotz-- 55672.00m install-rootfs-thinpool 91.89 install-rootfs-thinpool main-xr-vg twi-aotz-- 55580.00m 92.05 45.33 -Out------2021-06-11T02-42-16[MainThread][R1:vty]> install replace /misc/disk1//8000-x64-7.5.1.08I.iso noprompt Thu Jun 10 16:58:05.415 UTC Install replace operation 11.1 has started Install operation will continue in the background RP/0/RP0/CPU0:R1# RP/0/RP0/CPU0:R1# show install request Thu Jun 10 17:00:31.199 UTC User request: install replace /misc/disk1/8000-x64-7.5.1.08I.iso Operation ID: 11.1 State: Failure since 2021-06-10 16:58:21 UTC Disk space check failed on nodes: 0/RP1/CPU0. Remove unnecessary files in rootfs before retrying operation, or remove unnecessary rollback points using 'clear install rollback id '. If a transaction is currently in progress, it may need to be ended in order to free up disk space from removed files or rollback points. Automatically recovered after failure, ready for next user request. Current activity: No install operation in progress -Out------2021-06-11T02-45-15[MainThread][R1:vty]> install replace /misc/disk1//8000-x64-7.5.1.08I.iso commit force noprompt Thu Jun 10 17:01:04.414 UTC Install replace operation 12 has started Install operation will continue in the background RP/0/RP0/CPU0:R1# RP/0/RP0/CPU0:R1# show install request Thu Jun 10 17:03:27.949 UTC User request: install replace /misc/disk1/8000-x64-7.5.1.08I.iso commit force Operation ID: 12 State: Failure since 2021-06-10 17:01:20 UTC Disk space check failed on nodes: 0/RP1/CPU0. Remove unnecessary files in rootfs before retrying operation, or remove unnecessary rollback points using 'clear install rollback id '. If a transaction is currently in progress, it may need to be ended in order to free up disk space from removed files or rollback points. Automatically recovered after failure, ready for next user request. Current activity: No install operation in progress