Launching soon: The world's first vendor agnostic bug scrubLearn more & join waitlist
OPERATIONAL DEFECT DATABASE
...
...
+ We can observe stale entries for old NTP servers that were removed from APIC GUI long time ago. From root access on the switch we can see that OLD NTP Servers were never deleted from the NTP process. + The right NTP server is installed, but not preferred. LEAF-21# ssh root@0 -LEAF-21# ntpq -p remote refid st t when poll reach delay offset jitter ============================================================================== *test.ntp.server 100.5.0.1 7 u 3 64 377 0.529 -4.758 7.669 old.ntp.server 18.18.14.4 2 u 21d 64 0 37.330 24.291 0.000 <<<<< Old NTP servers that were removed from APIC UI long time ago. +usnyc3-ntp-003. .GPSs. 1 u 60 64 177 20.236 12.310 0.909 +time2.google.co .GOOG. 1 u 48 64 377 20.673 7.176 0.471 <<<<< Right NTP server not installed as it is supposed.
+ Version is 4.2.6h + NTP Faults F1700 for most of their switches in their environment. + NTP Server 16.39.34.1 is correctly installed under Fabric > Policies > Pod > Date and Time > FABRIC-POD-POLICY-GROUP + The NTP server is reachable from the management interface on the Leaf switch. LEAF-21# show ip route vrf management IP Route Table for VRF "management" '*' denotes best ucast next-hop '**' denotes best mcast next-hop '[x/y]' denotes [preference/metric] '%' in via output denotes VRF 0.0.0.0/0, ubest/mbest: 1/0 *via 100.60.2.1/32, mgmt0, [0], 1y25w, local LEAF-21# iping 16.39.34.1 -V management PING 216.239.35.4 (216.239.35.4): 56 data bytes 64 bytes from 16.39.34.1: icmp_seq=0 ttl=101 time=21.089 ms 64 bytes from 16.39.34.1: icmp_seq=1 ttl=101 time=21.001 ms 64 bytes from 16.39.34.1: icmp_seq=2 ttl=101 time=20.928 ms 64 bytes from 16.39.34.1 icmp_seq=3 ttl=101 time=20.954 ms 64 bytes from 16.39.34.1: icmp_seq=4 ttl=101 time=20.966 ms --- 216.239.35.4 ping statistics --- 5 packets transmitted, 5 packets received, 0.00% packet loss round-trip min/avg/max = 20.928/20.987/21.089 ms
## Allow some time for fault to get cleared. Typically gets cleared automatically in +/- 1 hr. 1. Restarting NTP process on leaf switches from root user fixed the issue. No need to restart the leaf switch LEAF-21# ssh root@0 LEAF-21# pidof ntp 51341 LEAF-21# kill -9 51341 2. Fault 1700 is cleared. 3. We repeated same procedure for every other switch with same NTP issue.