Symptom
We have seen some routes missing in graceful-restart scenario on SD-WAN Edge devices.
Conditions
Frequent Flaps of OMP sessions with vSmart with large number of routes.
Further Problem Description
During flaps of OMP session, Edge device received OMP routes each time session comes up and goes into graceful-restart state once connection goes down.
In certain timing conditions, if OMP session flaps multiple times while Edge is also in mid of processing the received route, some routes can go missing in routing table.
Note, this condition will be auto-cleared once device forms next OMP session with vsmart.
Working state with all routes:-
Edge-router#
R -> routes received
I -> routes installed
S -> routes sent
DOMAIN OVERLAY SITE REGION
PEER TYPE ID ID ID ID STATE UPTIME R/I/S
------------------------------------------------------------------------------------------------------
vsmart 1 1 1 None up 0:00:35:54 11275/11273/5 >> Session is UP with all routes
Problematic state with missing routes.
Edge-router# show omp peers
R -> routes received
I -> routes installed
S -> routes sent
DOMAIN OVERLAY SITE REGION
PEER TYPE ID ID ID ID STATE UPTIME R/I/S
------------------------------------------------------------------------------------------------------
vsmart 1 1 1 None init-in-gr 4519/4518/0 << Device is in GR state but we have less routes received/installed compared to working state.