Loading...
Loading...
SyncIQ policy schedules timeout fails to start, and so the policy fails. The concurrent jobs setting has been changed, and the setting conflicts with the bulk schedules set up to run during the backup window. Logging for this issue reports similar to the following in the isi_migrate and messages logs: isi_migrate[xxxx]: sched: Timing out policy <POL> after xxx secs isi_migrate[xxxx]: sched: siq_create_alert_internal: type: 2 (policy name: <POL>) SyncIQ scheduler failed to start policy. Timing out <POL> after xxx secs isi_migrate[xxxx]: sched: Killing policy: Timing out policy <POL> after xxx secsisi_migrate[5544]: sched: One or more jobs postponed due to max concurrent job limit (X) isi_migrate[5544]: sched: One or more jobs postponed due to max concurrent job limit (X) isi_migrate[5544]: sched: One or more jobs postponed due to max concurrent job limit (X) The schedule conflict may come from policies with a setting of either 'when snapshot taken' schedule or 'every 10 minutes' or similar.
The amount of SyncIQ schedules set up to run at same time, conflicts with the limit of the concurrent jobs setting on the cluster.
Review SyncIQ policy schedules and determine what is scheduled to run and when: `isi sync policies list -v | grep Schedule` Check cluster logs for similar processing as mentioned above. Review the cluster siq configuration for concurrent job setting: `cd /ifs/.ifsvar/modules/tsm/config` or in a log set: `cd local/ifsvar_modules.tar/modules/tsm/config` `cat siq-conf.gc` scheduler {token:1223, version:1} scheduler.max_concurrent_jobs {token:546} = "10" <<< see here, concurrent jobs reduced to 10 scheduler.last_rotate_reports_run {token:1223} = "1575279962" With the above confirmed, the administrator must review and modify siq policy schedules so to spread policies out correctly as mentioned in the OneFS CLI and WebUI admin guides. Else, the administrator can modify the concurrent job setting. For detailed instructions on configuring SyncIQ concurrent jobs and policy scheduling, refer to: Dell PowerScale SyncIQ Architecture, Configuration and Considerations: https://infohub.delltechnologies.com/l/dell-powerscale-synciq-architecture-configuration-and-considerations/ Dell PowerScale OneFS Job Engine White Paper (H12570.27): https://www.delltechnologies.com/asset/en-us/products/storage/industry-market/h12570-wp-powerscale-onefs-job-engine.pdf For monitoring concurrent job resource consumption, run isi job statistics list from the OneFS CLI.
Click on a version to see all relevant bugs
Dell Integration
Learn more about where this data comes from
BugZero Plan
Streamline upgrades with automated vendor bug scrubs
BugZero Prevent
Wish you caught this bug sooner? Get proactive today.