[c-nsp] MTU / BGP

Scott Granados scott at granados-llc.net
Mon Jul 20 08:49:41 EDT 2015


I’ve run in to this problem before.

Do something like
show neighbor a.b.c.d | inc data or | inc mss

You want to see what the maximum size is compared to MTU.  For example, on a 1500 MTU this number should be 1460.  In my case the issue was the interface MTU was set to 1522 to include QinQ tags but the router was negotiating BGP including the extra 22 bytes.  Setting IP MTU to 1500 or what ever your MTU is set to minus overhead did the trick.  IN my case something like

int gig 0/0/0
ip mtu 1500

Hope that helps.

> On Jul 20, 2015, at 6:22 AM, CiscoNSP List <cisconsp_list at hotmail.com> wrote:
> 
> Hi Adam,
> 
> Max I can get through is 1980:
> 
> 
> #ping xxx.xxx.xxx.213 size 1980 df-bit 
> Type escape sequence to abort.
> Sending 5, 1980-byte ICMP Echos to xxx.xxx.xxx.213, timeout is 2 seconds:
> Packet sent with the DF bit set
> !!!!!
> Success rate is 100 percent (5/5), round-trip min/avg/max = 32/32/32 ms
> 
> 
> #ping xxx.xxx.xxx.212 size 1980 df-bit 
> Type escape sequence to abort.
> Sending 5, 1980-byte ICMP Echos to xxx.xxx.xxx.212, timeout is 2 seconds:
> Packet sent with the DF bit set
> !!!!!
> Success rate is 100 percent (5/5), round-trip min/avg/max = 32/32/32 ms
> 
> 
> #ping xxx.xxx.xxx.212 size 1981 df-bit 
> Type escape sequence to abort.
> Sending 5, 1981-byte ICMP Echos to xxx.xxx.xxx.212, timeout is 2 seconds:
> Packet sent with the DF bit set
> M.M.M
> Success rate is 0 percent (0/5)
> 
> Cheers
> 
> ________________________________________
> From: Adam Vitkovsky <Adam.Vitkovsky at gamma.co.uk>
> Sent: Monday, 20 July 2015 8:10 PM
> To: CiscoNSP List; Mark Tinka; cisco-nsp at puck.nether.net
> Subject: RE: [c-nsp] MTU / BGP
> 
> Hi,
> 
> The jitter/delay -is just saying the Open message has been randomly delayed
> 
> This is the culprit:
> ASR received hold time expired from the ME
> Jul 20 2015 19:22:38.084 GMTEST: %BGP-5-NBR_RESET: Neighbor xxx.xxx.xxx.203 reset (Peer closed the session)
> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203 (0x7F4A31201CC0:1) Reset (Peer closed the session).
> Jul 20 2015 19:22:38.084 GMTEST: BGP: xxx.xxx.xxx.203 rcv message type 3, length (excl. header) 2
> Jul 20 2015 19:22:38.084 GMTEST: %BGP-3-NOTIFICATION: received from neighbor xxx.xxx.xxx.203 4/0 (hold time expired) 0 bytes
> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203 (0x7F4A31201CC0:1) Receive NOTIFICATION 4/0 (hold time expired) 0 bytes
> Jul 20 2015 19:22:38.084 GMTEST: BGP: xxx.xxx.xxx.203 went from Established to Closing
> 
> 
> ME did reset the session after 3Mins
> Jul 20 2015 19:19:37.161 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN
> .....
> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 connection timed out 180856ms (last update) 180000ms (hold time)
> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 went from Established to Closing
> Jul 20 2015 19:22:38.059 GMTEST: %BGP-3-NOTIFICATION: sent to neighbor xxx.xxx.xxx.213 4/0 (hold time expired) 0 bytes
> Jul 20 2015 19:22:38.059 GMTEST: BGP: ses global xxx.xxx.xxx.213 (0xCBF3828:1) Send NOTIFICATION 4/0 (hold time expired) 0 bytes
> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 local error close after sending NOTIFICATION
> Jul 20 2015 19:22:38.059 GMTEST: %BGP-5-NBR_RESET: Neighbor xxx.xxx.xxx.213 reset (BGP Notification sent)
> 
> What is the maximum MTU you can use to successfully ping between the loopbacks with df-bit set please?
> 
> 
> adam
>> -----Original Message-----
>> From: CiscoNSP List [mailto:CiscoNSP_list at hotmail.com]
>> Sent: 20 July 2015 10:33
>> To: Adam Vitkovsky; Mark Tinka; cisco-nsp at puck.nether.net
>> Subject: Re: [c-nsp] MTU / BGP
>> 
>> 
>> Thanks for your help Mark+Adam.
>> 
>> 
>> Mark - I adjusted connecting port tcp/mss to 1000, but unfortunately made
>> no difference (BGP still flapped on both sessions to the old RR's)
>> 
>> 
>> Adam - debug output below from both 1 x ME and 1 x ASR...the only thing
>> that stands out to me(But Im tired :) ) is the excess latency/jitter
>> line(s)...hopefully hotmail doesnt crew the formatting:
>> 
>> 
>> 
>> ASR RR:
>> 
>> Jul 20 2015 19:21:59.338 GMTEST: BGP: topo CUSTB:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo global:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet-full:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo global:IPv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo global:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet-full:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo CUSTB:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo global:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet-full:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo CUSTB:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo global:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet-full:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo global:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet-full:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:59.342 GMTEST: BGP: topo inet:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:01.027 GMTEST: BGP: topo CUSTB:VPNv4 Unicast:base
>> Aggregation processing not required
>> Jul 20 2015 19:22:24.130 GMTEST: %BGP-5-NBR_RESET: Neighbor
>> xxx.xxx.xxx.202 reset (Peer closed the session)
>> Jul 20 2015 19:22:24.130 GMTEST: %BGP-3-NOTIFICATION: received from
>> neighbor xxx.xxx.xxx.202 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:22:24.133 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.202 Down Peer closed the session
>> Jul 20 2015 19:22:24.133 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.202 VPNv6 Unicast topology base removed from session  Peer
>> closed the session
>> Jul 20 2015 19:22:24.133 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.202 VPNv4 Unicast topology base removed from session  Peer
>> closed the session
>> Jul 20 2015 19:22:24.133 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.202 IPv4 MDT topology base removed from session  Peer closed
>> the session
>> Jul 20 2015 19:22:36.973 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.202 Up
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) Remote close.
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.203 IPv4
>> Unicast:base (0x7F4A31201CC0:1) Not scheduling for GR processing [Peer will
>> not preserve forwarding]
>> Jul 20 2015 19:22:38.084 GMTEST: %BGP-5-NBR_RESET: Neighbor
>> xxx.xxx.xxx.203 reset (Peer closed the session)
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) Reset (Peer closed the session).
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: xxx.xxx.xxx.203 rcv message type 3,
>> length (excl. header) 2
>> Jul 20 2015 19:22:38.084 GMTEST: %BGP-3-NOTIFICATION: received from
>> neighbor xxx.xxx.xxx.203 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) Receive NOTIFICATION 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: xxx.xxx.xxx.203 went from
>> Established to Closing
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.203 IPv4
>> Unicast:base (0x7F4A31201CC0:1) NSF delete stale NSF not active
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.203 IPv4
>> Unicast:base (0x7F4A31201CC0:1) NSF no stale paths state is NSF not active
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.203 IPv4
>> Unicast:base (0x7F4A31201CC0:1) Resetting ALL counters.
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: xxx.xxx.xxx.203 closing
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) Session close and reset neighbor xxx.xxx.xxx.203
>> topostate
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.203 IPv4
>> Unicast:base (0x7F4A31201CC0:1) Resetting ALL counters.
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: xxx.xxx.xxx.203 went from Closing to
>> Idle
>> Jul 20 2015 19:22:38.084 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.203 Down Peer closed the session
>> Jul 20 2015 19:22:38.084 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.203 IPv4 Unicast topology base removed from session  Peer
>> closed the session
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) Removed topology IPv4 Unicast:base
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) Removed last topology
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: nbr global xxx.xxx.xxx.203 Open
>> active delayed 9216ms (35000ms max, 60% jitter)
>> Jul 20 2015 19:22:38.084 GMTEST: BGP: nbr global xxx.xxx.xxx.203 Active
>> open failed - open timer running
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive open to
>> xxx.xxx.xxx.213
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: Fetched peer xxx.xxx.xxx.203 from
>> tcb
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive went from
>> Idle to Connect
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Setting open delay timer to 60 seconds.
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas read request no-op
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive rcv message
>> type 1, length (excl. header) 44
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Receive OPEN
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive rcv OPEN,
>> version 4, holdtime 180 seconds
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive rcv OPEN w/
>> OPTION parameter len: 34
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive rcvd OPEN w/
>> optional parameter type 2 (Capability) len 6
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> CAPABILITY code: 1, length 4
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> MP_EXT CAP for afi/safi: 1/1
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive rcvd OPEN w/
>> optional parameter type 2 (Capability) len 2
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> CAPABILITY code: 128, length 0
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> ROUTE-REFRESH capability(old) for all address-families
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive rcvd OPEN w/
>> optional parameter type 2 (Capability) len 2
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> CAPABILITY code: 2, length 0
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> ROUTE-REFRESH capability(new) for all address-families
>> Jul 20 2015 19:22:46.680 GMTEST: BGP: xxx.xxx.xxx.203 passive rcvd OPEN w/
>> optional parameter type 2 (Capability) len 4
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> CAPABILITY code: 64, length 2
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas NSF OPEN has GR cap
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas NSF Peer has not restarted. Restart Time: 120
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive rcvd OPEN w/
>> optional parameter type 2 (Capability) len 2
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> CAPABILITY code: 70, length 0
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Enhanced Refresh cap received in open message
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive rcvd OPEN w/
>> optional parameter type 2 (Capability) len 6
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has
>> CAPABILITY code: 65, length 4
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive OPEN has 4-
>> byte ASN CAP for: 17766
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: nbr global xxx.xxx.xxx.203 neighbor
>> does not have IPv4 MDT topology activated
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive rcvd OPEN w/
>> remote AS 17766, 4-byte remote AS 17766
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Adding topology IPv4 Unicast:base
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Adding topology VPNv4 Unicast:base
>> Jul 20 2015 19:22:46.681 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.203 VPNv4 Unicast topology base removed from session
>> Capability changed
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Removed topology VPNv4 Unicast:base
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Send OPEN
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas NSF Building GR capability.
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.203 IPv4
>> Unicast:base (0x7F4A31201CC0:0) NSF Forwarding bit not set for 1/1(afi/safi)
>> due to NSF flag cleared
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:0) pas Building Enhanced Refresh capability
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive went from
>> Connect to OpenSent
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive sending
>> OPEN, version 4, my as: 17766, holdtime 180 seconds, ID CB954CD5
>> Jul 20 2015 19:22:46.681 GMTEST: BGP: xxx.xxx.xxx.203 passive went from
>> OpenSent to OpenConfirm
>> Jul 20 2015 19:22:46.713 GMTEST: BGP: xxx.xxx.xxx.203 passive went from
>> OpenConfirm to Established
>> Jul 20 2015 19:22:46.713 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) pas Assigned ID
>> Jul 20 2015 19:22:46.714 GMTEST: BGP: nbr global xxx.xxx.xxx.203 Stop Active
>> Open timer as all topologies are allocated
>> Jul 20 2015 19:22:46.714 GMTEST: BGP: ses global xxx.xxx.xxx.203
>> (0x7F4A31201CC0:1) Up
>> Jul 20 2015 19:22:46.714 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.203 Up
>> Jul 20 2015 19:22:46.714 GMTEST: BGP: xxx.xxx.xxx.203 rcv message type 5,
>> length (excl. header) 4
>> Jul 20 2015 19:22:46.714 GMTEST: BGP: xxx.xxx.xxx.203 rcvd REFRESH_REQ
>> for afi/safi: 1/1, refresh code is 1
>> Jul 20 2015 19:22:46.717 GMTEST: BGP: xxx.xxx.xxx.203 rcv message type 5,
>> length (excl. header) 4
>> Jul 20 2015 19:22:46.717 GMTEST: BGP: xxx.xxx.xxx.203 rcvd REFRESH_REQ
>> for afi/safi: 1/1, refresh code is 2
>> Jul 20 2015 19:22:46.717 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.203 IPv4
>> Unicast:base (0x7F4A31201CC0:1) NSF no stale paths state is NSF not active
>> Jul 20 2015 19:22:59.345 GMTEST: BGP: topo global:IPv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.346 GMTEST: BGP: topo global:IPv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.346 GMTEST: BGP: topo global:IPv4 MDT:base Scanning
>> routing tables
>> Jul 20 2015 19:22:59.346 GMTEST: BGP: topo global:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.346 GMTEST: BGP: topo inet-full:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.346 GMTEST: BGP: topo inet:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.346 GMTEST: BGP: topo CUSTB:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.349 GMTEST: BGP: topo global:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.349 GMTEST: BGP: topo inet-full:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.349 GMTEST: BGP: topo inet:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo global:IPv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo global:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet-full:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo CUSTB:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo global:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet-full:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo CUSTB:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo global:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet-full:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo global:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet-full:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:59.350 GMTEST: BGP: topo inet:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.353 GMTEST: BGP: topo global:IPv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.354 GMTEST: BGP: topo global:IPv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.354 GMTEST: BGP: topo global:IPv4 MDT:base Scanning
>> routing tables
>> Jul 20 2015 19:23:59.354 GMTEST: BGP: topo global:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.354 GMTEST: BGP: topo inet-full:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.354 GMTEST: BGP: topo inet:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.354 GMTEST: BGP: topo CUSTB:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo global:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet-full:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo global:IPv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo global:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet-full:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo CUSTB:VPNv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo global:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet-full:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo CUSTB:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo global:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet-full:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet:MVPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo global:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet-full:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.357 GMTEST: BGP: topo inet:VPNv6 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:59.742 GMTEST: %SNMP-3-AUTHFAIL: Authentication failure
>> for SNMP req from host 37.59.107.188
>> Jul 20 2015 19:24:00.691 GMTEST: BGP: topo inet-full:VPNv4 Unicast:base
>> Aggregation processing not required
>> Jul 20 2015 19:24:00.691 GMTEST: BGP: topo inet:VPNv4 Unicast:base
>> Aggregation processing not required
>> Jul 20 2015 19:24:00.691 GMTEST: BGP: topo CUSTB:VPNv4 Unicast:base
>> Aggregation processing not required
>> 
>> 
>> "New" ME01:
>> 
>> 
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 2, length 0
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> ROUTE-REFRESH capability(new) for all address-families
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 8
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 64, length 6
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF OPEN has GR cap
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF Peer has not restarted. Restart Time: 120
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF Address family IPv4 Unicast is NOT preserved
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF Address family IPv4 Unicast is NOT SET for nbit
>> Jul 20 2015 19:19:37.161 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 2
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 70, length 0
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Enhanced Refresh cap received in open message
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 6
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 69, length 4
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Additional Paths cap val 3 logged for afi/safi: 1/1
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Additional Paths cap received as SEND RECEIVE for afi/safi:
>> 1/1.
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 6
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 65, length 4
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has 4-
>> byte ASN CAP for: 17766
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: nbr global xxx.xxx.xxx.213 neighbor
>> does not have IPv4 MDT topology activated
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> remote AS 17766, 4-byte remote AS 17766
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:0) NSF abort (has not preserved AF)
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:0) NSF state went from NSF not active to NSF
>> delete all paths
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active went from
>> OpenSent to OpenConfirm
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 active went from
>> OpenConfirm to Established
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) act Assigned ID
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: xxx.xxx.xxx.213 sending
>> REFRESH_REQ(5) for afi/safi: 1/1, refresh code is 1
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) Up
>> Jul 20 2015 19:19:37.165 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.213 Up
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) NSF Service (NSF delete all paths)
>> Jul 20 2015 19:19:37.165 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) NSF state went from NSF delete all paths to NSF
>> not active
>> Jul 20 2015 19:19:37.169 GMTEST: BGP: xxx.xxx.xxx.213 sending
>> REFRESH_REQ(5) for afi/safi: 1/1, refresh code is 2
>> Jul 20 2015 19:19:58.677 GMTEST: BGP: topo global:IPv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:19:58.677 GMTEST: BGP: topo global:IPv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:19:58.677 GMTEST: BGP: topo global:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:19:58.677 GMTEST: BGP: topo global:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:19:58.677 GMTEST: BGP: topo global:IPv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:19:58.677 GMTEST: BGP: topo global:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:20:34.102 GMTEST: %BGP-3-NOTIFICATION: sent to neighbor
>> xxx.xxx.xxx.212 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:20:34.102 GMTEST: %BGP-5-NBR_RESET: Neighbor
>> xxx.xxx.xxx.212 reset (BGP Notification sent)
>> Jul 20 2015 19:20:34.102 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 Down BGP Notification sent
>> Jul 20 2015 19:20:34.102 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 VPNv6 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:20:34.102 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 VPNv4 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:20:34.102 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 IPv4 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:20:40.658 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 Up
>> Jul 20 2015 19:20:58.682 GMTEST: BGP: topo global:IPv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:20:58.682 GMTEST: BGP: topo global:IPv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:20:58.682 GMTEST: BGP: topo global:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:20:58.682 GMTEST: BGP: topo global:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:20:58.682 GMTEST: BGP: topo global:IPv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:20:58.682 GMTEST: BGP: topo global:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:58.687 GMTEST: BGP: topo global:IPv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:58.687 GMTEST: BGP: topo global:IPv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:58.687 GMTEST: BGP: topo global:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:58.687 GMTEST: BGP: topo global:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:58.687 GMTEST: BGP: topo global:IPv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:21:58.687 GMTEST: BGP: topo global:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 connection timed out
>> 180856ms (last update) 180000ms (hold time)
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 went from
>> Established to Closing
>> Jul 20 2015 19:22:38.059 GMTEST: %BGP-3-NOTIFICATION: sent to neighbor
>> xxx.xxx.xxx.213 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) Send NOTIFICATION 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 local error close after
>> sending NOTIFICATION
>> Jul 20 2015 19:22:38.059 GMTEST: %BGP-5-NBR_RESET: Neighbor
>> xxx.xxx.xxx.213 reset (BGP Notification sent)
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) NSF delete stale NSF not active
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) NSF no stale paths state is NSF not active
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) Resetting ALL counters.
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 closing
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) Session close and reset neighbor xxx.xxx.xxx.213 topostate
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) Resetting ALL counters.
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: xxx.xxx.xxx.213 went from Closing to
>> Idle
>> Jul 20 2015 19:22:38.059 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.213 Down BGP Notification sent
>> Jul 20 2015 19:22:38.059 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.213 IPv4 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) Removed topology IPv4 Unicast:base
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) Removed last topology
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: nbr global xxx.xxx.xxx.213 Open
>> active delayed 9216ms (35000ms max, 60% jitter)
>> Jul 20 2015 19:22:38.059 GMTEST: BGP: nbr global xxx.xxx.xxx.213 Active
>> open failed - open timer running
>> Jul 20 2015 19:22:46.623 GMTEST: BGP: xxx.xxx.xxx.213 active went from Idle
>> to Active
>> Jul 20 2015 19:22:46.623 GMTEST: BGP: xxx.xxx.xxx.213 open active, local
>> address xxx.xxx.xxx.203
>> Jul 20 2015 19:22:46.655 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Adding topology IPv4 Unicast:base
>> Jul 20 2015 19:22:46.655 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Send OPEN
>> Jul 20 2015 19:22:46.655 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF Building GR capability.
>> Jul 20 2015 19:22:46.655 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Building Enhanced Refresh capability
>> Jul 20 2015 19:22:46.655 GMTEST: BGP: xxx.xxx.xxx.213 active went from
>> Active to OpenSent
>> Jul 20 2015 19:22:46.655 GMTEST: BGP: xxx.xxx.xxx.213 active sending OPEN,
>> version 4, my as: 17766, holdtime 180 seconds, ID CB954CCB
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcv message
>> type 1, length (excl. header) 56
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Receive OPEN
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcv OPEN,
>> version 4, holdtime 180 seconds
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcv OPEN w/
>> OPTION parameter len: 46
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 6
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 1, length 4
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> MP_EXT CAP for afi/safi: 1/1
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 2
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 128, length 0
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> ROUTE-REFRESH capability(old) for all address-families
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 2
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 2, length 0
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> ROUTE-REFRESH capability(new) for all address-families
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 8
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 64, length 6
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF OPEN has GR cap
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF Peer has not restarted. Restart Time: 120
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF Address family IPv4 Unicast is NOT preserved
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act NSF Address family IPv4 Unicast is NOT SET for nbit
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 2
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 70, length 0
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Enhanced Refresh cap received in open message
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 6
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 69, length 4
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Additional Paths cap val 3 logged for afi/safi: 1/1
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:0) act Additional Paths cap received as SEND RECEIVE for afi/safi:
>> 1/1.
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> optional parameter type 2 (Capability) len 6
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has
>> CAPABILITY code: 65, length 4
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active OPEN has 4-
>> byte ASN CAP for: 17766
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: nbr global xxx.xxx.xxx.213 neighbor
>> does not have IPv4 MDT topology activated
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active rcvd OPEN w/
>> remote AS 17766, 4-byte remote AS 17766
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:0) NSF abort (has not preserved AF)
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:0) NSF state went from NSF not active to NSF
>> delete all paths
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active went from
>> OpenSent to OpenConfirm
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 active went from
>> OpenConfirm to Established
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) act Assigned ID
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: xxx.xxx.xxx.213 sending
>> REFRESH_REQ(5) for afi/safi: 1/1, refresh code is 1
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: ses global xxx.xxx.xxx.213
>> (0xCBF3828:1) Up
>> Jul 20 2015 19:22:46.687 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.213 Up
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) NSF Service (NSF delete all paths)
>> Jul 20 2015 19:22:46.687 GMTEST: BGP: nbr_topo global xxx.xxx.xxx.213 IPv4
>> Unicast:base (0xCBF3828:1) NSF state went from NSF delete all paths to NSF
>> not active
>> Jul 20 2015 19:22:46.691 GMTEST: BGP: xxx.xxx.xxx.213 sending
>> REFRESH_REQ(5) for afi/safi: 1/1, refresh code is 2
>> Jul 20 2015 19:22:58.692 GMTEST: BGP: topo global:IPv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:58.692 GMTEST: BGP: topo global:IPv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:58.692 GMTEST: BGP: topo global:VPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:58.692 GMTEST: BGP: topo global:VPNv6 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:58.692 GMTEST: BGP: topo global:IPv4 Multicast:base
>> Scanning routing tables
>> Jul 20 2015 19:22:58.692 GMTEST: BGP: topo global:MVPNv4 Unicast:base
>> Scanning routing tables
>> Jul 20 2015 19:23:41.624 GMTEST: %BGP-3-NOTIFICATION: sent to neighbor
>> xxx.xxx.xxx.212 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:23:41.624 GMTEST: %BGP-5-NBR_RESET: Neighbor
>> xxx.xxx.xxx.212 reset (BGP Notification sent)
>> Jul 20 2015 19:23:41.624 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 Down BGP Notification sent
>> Jul 20 2015 19:23:41.624 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 VPNv6 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:23:41.624 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 VPNv4 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:23:41.624 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 IPv4 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:23:49.960 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.212 Up
>> Jul 20 2015 19:23:59.732 GMTEST: %SNMP-3-AUTHFAIL: Authentication failure
>> for SNMP req from host 37.59.107.188
>> Jul 20 2015 19:25:47.586 GMTEST: %BGP-3-NOTIFICATION: sent to neighbor
>> xxx.xxx.xxx.213 4/0 (hold time expired) 0 bytes
>> Jul 20 2015 19:25:47.586 GMTEST: %BGP-5-NBR_RESET: Neighbor
>> xxx.xxx.xxx.213 reset (BGP Notification sent)
>> Jul 20 2015 19:25:47.586 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.213 Down BGP Notification sent
>> Jul 20 2015 19:25:47.586 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.213 IPv4 Unicast topology base removed from session  BGP
>> Notification sent
>> Jul 20 2015 19:25:55.130 GMTEST: %BGP-5-ADJCHANGE: neighbor
>> xxx.xxx.xxx.213 Up
>> 
>> 
>> 
>> Cheers/
>> 
>> 
>> 
>> ________________________________________
>> From: Adam Vitkovsky <Adam.Vitkovsky at gamma.co.uk>
>> Sent: Monday, 20 July 2015 7:13 PM
>> To: CiscoNSP List; Mark Tinka; cisco-nsp at puck.nether.net
>> Subject: RE: [c-nsp] MTU / BGP
>> 
>> Hi,
>> 
>> Once the session is up do you see all the routes being exchanged between
>> the new MEs and old RRs?
>> How many routes do the new MEs receive/advertise from/to the old RRs?
>> (just would like to rule out the max number of prefixes trigger for session
>> reset)
>> 
>> Let's try "debug ip bgp x.x.x.x" on both ends.
>> To find out what each end thinks is the reason for the session reset.
>> 
>> 
>> adam
>>> -----Original Message-----
>>> From: CiscoNSP List [mailto:CiscoNSP_list at hotmail.com]
>>> Sent: 20 July 2015 09:43
>>> To: Adam Vitkovsky; Mark Tinka; cisco-nsp at puck.nether.net
>>> Subject: Re: [c-nsp] MTU / BGP
>>> 
>>> 
>>> 
>>> Hi Adam/Mark - Unfortunately that command isnt available on the ME3600
>>> 
>>> I enabled:
>>> 
>>> 
>>> debug ip bgp xxx.xxx.xxx.213 updates
>>> 
>>> debug ip bgp events
>>> 
>>> 
>>> Results below...latency and jitter the cause?  (Strange, as I can send 5000 x
>>> 1500byte pings from ME->"old" ASR, and not get one loss, nor any huge
>>> fluctuations in latency?) - And I have a "stable" BGP session from the "new"
>>> RR's -> another PE, that is approx 20m/sec away?
>>> 
>>> 
>>> 
>>> i.e.
>>> 
>>> Success rate is 100 percent (5000/5000), round-trip min/avg/max =
>> 28/32/76
>>> ms
>>> 
>>> 
>>> Ive been working on multiple things today, little sleep, so may be missing
>>> something completely obvious to some fresh eyes :)
>>> 
>>> 
>>> .212 and .213 are the "old" RR's......203 is one of the "new" ME's
>>> 
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: %BGP-5-ADJCHANGE: neighbor
>>> xxx.xxx.xxx.212 Down BGP Notification sent
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>>> xxx.xxx.xxx.212 VPNv6 Unicast topology base removed from session  BGP
>>> Notification sent
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:1) Removed topology VPNv6 Unicast:base
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>>> xxx.xxx.xxx.212 VPNv4 Unicast topology base removed from session  BGP
>>> Notification sent
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:1) Removed topology VPNv4 Unicast:base
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: %BGP_SESSION-5-ADJCHANGE: neighbor
>>> xxx.xxx.xxx.212 IPv4 Unicast topology base removed from session  BGP
>>> Notification sent
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:1) Removed topology IPv4 Unicast:base
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:1) Removed last topology
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: BGP: nbr global xxx.xxx.xxx.212 Open
>>> active delayed 9216ms (35000ms max, 60% jitter)
>>> 
>>> Jul 20 2015 18:22:06.391 GMTEST: BGP: nbr global xxx.xxx.xxx.212 Active
>>> open failed - open timer running
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive open to
>>> xxx.xxx.xxx.203
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: Fetched peer xxx.xxx.xxx.212 from
>>> tcb
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive went from
>>> Idle to Connect
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas Setting open delay timer to 60 seconds.
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcv message
>>> type 1, length (excl. header) 80
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas Receive OPEN
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcv OPEN,
>>> version 4, holdtime 180 seconds
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcv OPEN w/
>>> OPTION parameter len: 70
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcvd OPEN
>> w/
>>> optional parameter type 2 (Capability) len 6
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> CAPABILITY code: 1, length 4
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> MP_EXT CAP for afi/safi: 2/128
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcvd OPEN
>> w/
>>> optional parameter type 2 (Capability) len 6
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> CAPABILITY code: 1, length 4
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> MP_EXT CAP for afi/safi: 1/128
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcvd OPEN
>> w/
>>> optional parameter type 2 (Capability) len 6
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> CAPABILITY code: 1, length 4
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> MP_EXT CAP for afi/safi: 1/1
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcvd OPEN
>> w/
>>> optional parameter type 2 (Capability) len 2
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> CAPABILITY code: 128, length 0
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> ROUTE-REFRESH capability(old) for all address-families
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcvd OPEN
>> w/
>>> optional parameter type 2 (Capability) len 2
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> CAPABILITY code: 2, length 0
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> ROUTE-REFRESH capability(new) for all address-families
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive rcvd OPEN
>> w/
>>> optional parameter type 2 (Capability) len 16
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: xxx.xxx.xxx.212 passive OPEN has
>>> CAPABILITY code: 64, length 14
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF OPEN has GR cap
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF Peer has not restarted. Restart Time: 120
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF Address family VPNv6 Unicast is NOT preserved
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF Address family VPNv6 Unicast is NOT SET for nbit
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF Address family VPNv4 Unicast is NOT preserved
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF Address family VPNv4 Unicast is NOT SET for nbit
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF Address family IPv4 Unicast is NOT preserved
>>> 
>>> Jul 20 2015 18:22:12.811 GMTEST: BGP: ses global xxx.xxx.xxx.212
>>> (0xCBF3828:0) pas NSF Address family IPv4 Unicast is NOT SET for nbit
>>> 
>>> 
>>> 
>>> Cheers
>>> 
>>> ________________________________________
>>> From: Adam Vitkovsky <Adam.Vitkovsky at gamma.co.uk>
>>> Sent: Monday, 20 July 2015 5:11 PM
>>> To: CiscoNSP List; Mark Tinka; cisco-nsp at puck.nether.net
>>> Subject: RE: [c-nsp] MTU / BGP
>>> 
>>> Hi,
>>> 
>>> Cmd: "ip tcp mss" affects TCP sessions only so BGP however also LDP
>>> sessions.
>>> 
>>> What does the log says is the reason for the session drop please?
>>> If there's nothing obvious can you do "debug ip bgp x.x.x.x session" to see
>>> more details.
>>> 
>>> 
>>> adam
>>>> -----Original Message-----
>>>> From: cisco-nsp [mailto:cisco-nsp-bounces at puck.nether.net] On Behalf
>> Of
>>>> CiscoNSP List
>>>> Sent: 20 July 2015 08:02
>>>> To: Mark Tinka; cisco-nsp at puck.nether.net
>>>> Subject: Re: [c-nsp] MTU / BGP
>>>> 
>>>> 
>>>> Thanks Mark - I have existing OSPF/MPLS/BGP sessions running over the
>>>> links (Apart from the "new" ME's to the "old" RR's) - Adjusting MTU on
>> the
>>>> new ME's(Only), will it break any of those existing sessions? (As OSPF is
>>> very
>>>> particular about MTU)
>>>> 
>>>> 
>>>> ________________________________________
>>>> From: Mark Tinka <mark.tinka at seacom.mu>
>>>> Sent: Monday, 20 July 2015 4:56 PM
>>>> To: CiscoNSP List; cisco-nsp at puck.nether.net
>>>> Subject: Re: [c-nsp] MTU / BGP
>>>> 
>>>> On 20/Jul/15 08:47, CiscoNSP List wrote:
>>>>> Hi Everyone,
>>>>> 
>>>>> 
>>>>> 
>>>>> Have a new POP, 2 x ASR1000's (Acting as RR's), and 2 x ME3600's - We
>>> have
>>>> another POP with 2 x ASR1000's also acting as RR's.
>>>>> 
>>>>> 
>>>>> 
>>>>> The 2 "new" ME's are peered to the "new" ASR's RR's, but if I try to
>>>> establish BGP  session with the existing RR's, session establishes, but
>> then
>>>> drops on both ME's after ~4minutes...I *think* it's due to MTU, and have
>>>> tried disabling path mtu discovery, but it doesnt appear to do anything?
>>> (also
>>>> tried it with it enabled, and the results are the same)
>>>>> 
>>>>> 
>>>>> 
>>>>> i.e. no neighbour xxx.xxx.xxx.xxx transport path-mtu-discovery on the
>>>> ME's, I see
>>>>> 
>>>>> 
>>>>> 
>>>>> Datagrams (max data segment is 9036 bytes):
>>>>> 
>>>>> 
>>>>> 
>>>>> On the ASR RR's I see
>>>>> 
>>>>> 
>>>>> 
>>>>> Datagrams (max data segment is 1940 bytes):
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> Any suggestions are greatly appreciated.
>>>> 
>>>> If you think it is MTU, configure "ip tcp mss" to something like 1000
>>>> and test again.
>>>> 
>>>> Mark.
>>>> _______________________________________________
>>>> cisco-nsp mailing list  cisco-nsp at puck.nether.net
>>>> https://puck.nether.net/mailman/listinfo/cisco-nsp
>>>> archive at http://puck.nether.net/pipermail/cisco-nsp/
> _______________________________________________
> cisco-nsp mailing list  cisco-nsp at puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/



More information about the cisco-nsp mailing list