Symptom

#show app-hosting list will result in an empty list P.S only ThousandEyes agent was tested, there were no other apps running. runtime:DEBUG] [MainThread] [errorsreport.py:172 - __init__()] Error reporting filename: /var/log/caf/caf.log, backup count: 5 [runtime.py:713 - _verify_caf_repo_consistency()] No start.ini found so no app installed yet. Verifying consistency <<<<<< [runtime.service:INFO] [MainThread] [runtime.py:719 - _verify_caf_repo_consistency()] Inconsistency found between iox work dor and app dir, cleaning up iox work dir [runtime.service:INFO] [MainThread] [runtime.py:734 - _verify_caf_repo_consistency()] Removing app work folder:/mnt/sd3/iox_alt_hdd_mount_dir/iox We verfied that from the shell : [nj64rs0001_3_RP_0:/]$ cd /mnt/sd3/ [nj64rs0001_3_RP_0:/mnt/sd3]$ ls -la total 4198460 drwxr-xr-x. 7 root root 4096 May 21 17:18 . drwxr-xr-x. 9 root root 180 May 21 17:15 .. drwxr-xr-x. 2 root root 4096 Jan 17 2020 .install -rw-r--r--. 1 root root 348 May 21 17:18 .iox_dir_list drwxr-xr-x. 2 root root 4096 Mar 12 2020 POE drwxr-xr-x. 15 root root 4096 May 21 17:18 iox -rw-r--r--. 1 root root 4294967296 Jun 19 17:31 iox_alt_hdd.dsk drwxr-xr-x. 8 root root 4096 May 21 17:18 iox_alt_hdd_mount_dir drwxr-xr-x. 24 root network-admin 4096 Jun 20 11:12 user [nj64rs0001_3_RP_0:/mnt/sd3]$ Unfortunately, the caf log file was overwritten. ###Working device : $ find . -name start.ini ./vol/usb1/iox/repo/start.ini [sr12sw1000_1_RP_0:/]$ ## Non-working device : $ find . -name start.ini find: './proc/23263': No such file or directory

Conditions

1. Upgrading a C9300 device from 17.3.x to 17.6.x or 17.6.x 2. Having a ThousandEyes agent installed and running. 3. The issue is more probable when the agent is installed on the flash not on a USB i.e all of the reported incidents were on devices where the agent is installed on the flash not an external USB drive

Workaround

Re-install the agent on the impacted devices.

Further Problem Description