<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
span.E-MailFormatvorlage17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1584485317;
mso-list-type:hybrid;
mso-list-template-ids:-2085349216 67567631 67567641 67567643 67567631 67567641 67567643 67567631 67567641 67567643;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DE" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">went through archive but can’t find anyone facing the same problems.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">We have a set of 5 CER (3 of them RT running bgp full table). Ospf/Mpls/IBGP4vpnve full mesh,EBGP running.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">We have a large l3vpn (vrf) running bgp multipathing and ebgp as PE-CE Routing Protocol. Two of them inserting a default route into vrf.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">We started seeing issue when upgrading to 5.4a (at that time not running any RT’s). If a route in this VRF flaps one of the CER’s starts blackholing traffic. It is announcing the prefixes to peers but not forwarding the
traffic. At first view labels look correct.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Running “clearip bgp vrf <VRF-NAME> neigh all” clears the error.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Starting with the “new” –RT’s running firmware 5.6d we can force this issue by<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo1"><![if !supportLists]><span lang="EN-US"><span style="mso-list:Ignore">1.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US">Creating a new vrf<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo1"><![if !supportLists]><span lang="EN-US"><span style="mso-list:Ignore">2.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US">Create bgp address family for this VRF<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">When at point 2 the big VRF breakes on this router.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">When it was broken we did run the following commands on all routers to fetch debug info before clearing the bgp neighbors:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show tech<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.74 advertised-routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.74 routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.74 routes-summary<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.75 advertised-routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.75 routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.75 routes-summary<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.69 advertised-routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.69 routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.69 routes summary<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.84 advertised-routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.84 routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">show ip bgp vpnv4 neighbors <peer>.84 routes-summary<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">sh mpls forwarding<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">sh ip bgp vrf <VRF> routes det<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">sh ip bgp vrf <VRF> tags<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">any hints on additional commands or on what to look for in the debug text files?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Nils</span><span style="mso-fareast-language:DE"><o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>