[c-nsp] BFD flapping on 6509 SUP720-3BXL

Ross Halliday ross.halliday at wtccommunications.ca
Wed Feb 29 13:37:56 EST 2012 

Hello list,

I'm getting a load of BFD flaps on all ISIS (MPLS) links to a specific PE router. The router core-site_1-c6509 is at a central site that provides connectivity for our MPLS network such as linsite_3 to our Internet edge router, subscriber termination, VoIP access, etc. Based on my searching I'm guessing that is CPU load on core-site_1-c6509 is too high or erratic for the low BFD timers. It's doing all of this with a SUP720-3BXL. 

Here's a lame ASCII diagram of the connectivity into this one 6509 with the IGPs labelled: (ISIS are also MPLS links)

+-----------------+                       +-----------------+
|edge-site_1-c6509|----+                  |core-site_3-c6513|
|     (eBGP)      |---+|              +---|     (ISIS)      |
+-----------------+   ||              |   +-----------------+
                      ||              |            |
                     +-----------------+  +-----------------+
                     |core-site_1-c6509|--|core-site_2-c6509|
                     | (ISIS/BGP/OSPF) |--|     (ISIS)      |
                     +-----------------+  +-----------------+
                      |               |
+-----------------+   |               |   +-----------------+
|voip-site_1-c6509|---+(x4)           +---|core-site_4-c7204|
|     (OSPF)      |                       |     (ISIS)      |
+-----------------+                       +-----------------+

Our network is configured with the recommendations from http://www.cisco.com/en/US/docs/ios/iproute_isis/configuration/guide/irs_fsc.html. What confuses me is that core-site_1-c6509 has non-ISIS, non-MPLS links to other routers (VoIP gear and Internet edge) that are also configured with "bfd interval 50 min_rx 50 multiplier 4", yet these are not experiencing the same flaps.

The interfaces with the flaps don't have any errors, and links whose fibers have nothing to do with each other are sometimes blowing up at the same time (see below). The one thing I do see are some QoS drops. I can provide more info if wanted, but I that would indeed be a wall of text. I figured I might as well check with the experts if I am on the right track (turn down the BFD timers) before hammering the list with all that junk.

Thanks!

Ross


Feb 29 04:18:54 core-site_1-c6509 205773: Feb 29 04:18:53: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Down, BFD hold time expired
Feb 29 04:18:55 core-site_1-c6509 205774: Feb 29 04:18:54: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Up, new adjacency
Feb 29 06:01:54 core-site_1-c6509 205788: Feb 29 06:01:53: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Down, BFD hold time expired
Feb 29 06:01:55 core-site_1-c6509 205789: Feb 29 06:01:54: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Up, new adjacency
Feb 29 06:21:01 core-site_1-c6509 205790: Feb 29 06:21:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Down, BFD hold time expired
Feb 29 06:21:01 core-site_1-c6509 205791: Feb 29 06:21:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Down, BFD hold time expired
Feb 29 06:21:01 core-site_1-c6509 205792: Feb 29 06:21:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_3-c6513 (GigabitEthernet7/6) Down, BFD hold time expired
Feb 29 06:21:01 core-site_1-c6509 205793: Feb 29 06:21:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Down, BFD hold time expired
Feb 29 06:21:03 core-site_1-c6509 205794: Feb 29 06:21:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Up, new adjacency
Feb 29 06:21:03 core-site_1-c6509 205795: Feb 29 06:21:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 06:21:03 core-site_1-c6509 205796: Feb 29 06:21:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_3-c6513 (GigabitEthernet7/6) Up, new adjacency
Feb 29 06:21:03 core-site_1-c6509 205797: Feb 29 06:21:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Up, new adjacency
Feb 29 06:21:03 core-site_3-c6513 70427: Feb 29 06:21:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet8/1) Up, new adjacency
Feb 29 06:21:03 core-site_2-c6509 49244: Feb 29 06:21:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 06:21:03 core-site_2-c6509 49245: Feb 29 06:21:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet5/1) Up, new adjacency
Feb 29 07:23:17 core-site_2-c6509 49246: Feb 29 07:23:16: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet5/1) Down, BFD hold time expired
Feb 29 07:23:17 core-site_1-c6509 205861: Feb 29 07:23:16: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Down, BFD hold time expired
Feb 29 07:23:17 core-site_1-c6509 205862: Feb 29 07:23:17: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 07:23:19 core-site_2-c6509 49247: Feb 29 07:23:18: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet5/1) Up, new adjacency
Feb 29 07:40:44 core-site_1-c6509 205886: Feb 29 07:40:43: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Down, BFD hold time expired
Feb 29 07:40:45 core-site_1-c6509 205887: Feb 29 07:40:44: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Up, new adjacency
Feb 29 07:40:55 core-site_1-c6509 205888: Feb 29 07:40:54: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Down, BFD hold time expired
Feb 29 07:40:55 core-site_2-c6509 49248: Feb 29 07:40:54: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet6/1) Down, BFD hold time expired
Feb 29 07:40:55 core-site_1-c6509 205889: Feb 29 07:40:54: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Down, BFD hold time expired
Feb 29 07:40:56 core-site_2-c6509 49249: Feb 29 07:40:55: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 07:40:56 core-site_1-c6509 205890: Feb 29 07:40:55: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Up, new adjacency
Feb 29 07:40:56 core-site_1-c6509 205891: Feb 29 07:40:55: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Up, new adjacency
Feb 29 07:48:00 core-site_2-c6509 49250: Feb 29 07:47:59: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet5/1) Down, BFD hold time expired
Feb 29 07:48:00 core-site_2-c6509 49251: Feb 29 07:47:59: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet6/1) Down, BFD hold time expired
Feb 29 07:48:00 core-site_1-c6509 205895: Feb 29 07:47:59: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Down, BFD hold time expired
Feb 29 07:48:00 core-site_1-c6509 205896: Feb 29 07:47:59: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Down, BFD hold time expired
Feb 29 07:48:00 core-site_1-c6509 205897: Feb 29 07:47:59: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Down, BFD hold time expired
Feb 29 07:48:01 core-site_1-c6509 205899: Feb 29 07:48:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 07:48:01 core-site_1-c6509 205900: Feb 29 07:48:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Up, new adjacency
Feb 29 07:48:01 core-site_1-c6509 205901: Feb 29 07:48:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Up, new adjacency
Feb 29 07:48:01 core-site_2-c6509 49252: Feb 29 07:48:00: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 07:48:01 core-site_2-c6509 49253: Feb 29 07:48:01: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet5/1) Up, new adjacency
Feb 29 07:54:47 core-site_3-c6513 70477: Feb 29 07:54:47: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet8/1) Down, BFD hold time expired
Feb 29 07:54:48 core-site_2-c6509 49254: Feb 29 07:54:47: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet5/1) Down, BFD hold time expired
Feb 29 07:54:48 core-site_2-c6509 49255: Feb 29 07:54:47: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet6/1) Down, BFD hold time expired
Feb 29 07:54:48 core-site_1-c6509 205911: Feb 29 07:54:47: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Down, BFD hold time expired
Feb 29 07:54:48 core-site_1-c6509 205912: Feb 29 07:54:47: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_3-c6513 (GigabitEthernet7/6) Down, BFD hold time expired
Feb 29 07:54:48 core-site_1-c6509 205913: Feb 29 07:54:47: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Down, BFD hold time expired
Feb 29 07:54:48 core-site_1-c6509 205914: Feb 29 07:54:48: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 07:54:49 core-site_1-c6509 205915: Feb 29 07:54:48: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_2-c6509 (GigabitEthernet7/13) Up, new adjacency
Feb 29 07:54:49 core-site_1-c6509 205916: Feb 29 07:54:48: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_3-c6513 (GigabitEthernet7/6) Up, new adjacency
Feb 29 07:54:49 core-site_2-c6509 49256: Feb 29 07:54:48: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet6/1) Up, new adjacency
Feb 29 07:54:49 core-site_2-c6509 49257: Feb 29 07:54:48: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet5/1) Up, new adjacency
Feb 29 07:54:49 core-site_3-c6513 70483: Feb 29 07:54:48: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_1-c6509 (GigabitEthernet8/1) Up, new adjacency
Feb 29 11:03:45 core-site_1-c6509 206270: Feb 29 11:03:44: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Down, BFD hold time expired
Feb 29 11:03:46 core-site_1-c6509 206271: Feb 29 11:03:45: %CLNS-5-ADJCHANGE: ISIS: Adjacency to core-site_4-c7204 (GigabitEthernet7/1) Up, new adjacency

More information about the cisco-nsp mailing list