<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-ZA" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hi Donald,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">As murphy would have it, it took some time, but there has been a jump now in memory usage.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">PS auxxw on Thursday:<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">root@MY-LOC-RS01A:~# ps auxxw|grep bgpd</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">root 802 0.0 0.0 8784 2844 ? S<s Sep26 1:02 /usr/lib/frr/watchfrr -d -F traditional zebra mgmtd bgpd ospfd ospf6d staticd</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">frr 850 16.8 54.7 4656684 4429752 ? S<sl Sep26 547:23 /usr/lib/frr/bgpd -d -F traditional -A 127.0.0.1 -M rpki -e 10</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">root 12813 0.0 0.0 6608 2312 pts/2 S+ 17:21 0:00 grep --color=auto bgpd</span><o:p></o:p></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Saturday:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">root@MY-LOC-RS01A</span><span style="mso-fareast-language:EN-US">:~# ps auxxw|grep bgp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">root 802 0.0 0.0 8784 2568 ? S<s Sep26 1:48 /usr/lib/frr/watchfrr -d -F traditional zebra mgmtd bgpd ospfd ospf6d staticd<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">frr 850 15.0 54.9 4730544 4442820 ? S<sl Sep26 862:04 /usr/lib/frr/bgpd -d -F traditional -A 127.0.0.1 -M rpki -e 10<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">root 17862 0.0 0.0 6608 2164 pts/3 S+ 10:39 0:00 grep --color=auto bgp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">So there is a 73MB increase in memory usage<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">bgp mem usage:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">System allocator statistics:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Total heap allocated: > 2GB<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Holding block headers: 36 MiB<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Used small blocks: 0 bytes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Used ordinary blocks: > 2GB<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Free small blocks: 3200 bytes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Free ordinary blocks: 961 MiB<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Ordinary blocks: 964493<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Small blocks: 86<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Holding blocks: 3<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">(see system documentation for 'mallinfo' for meaning)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">--- qmem logging subsystem ---<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Type : Current# Size Total Max# MaxBytes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">syslog target : 1 56 56 1 56<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">--- qmem libfrr ---<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Type : Current# Size Total Max# MaxBytes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">log thread-local buffer : 2 24608 49232 2 49232<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Redistribution instance IDs : 6 2 144 6 144<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Zclient : 2 3144 6288 2 6288<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">YANG data structure : 0 1032 0 1 1032<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">YANG module : 5 48 296 5 296<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Work queue name string : 7 variable 200 7 200<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Work queue item : 0 24 0 112 2688<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Work queue : 7 144 1064 7 1064<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">VTY server : 2 32 80 2 80<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">VTY : 4 variable 61216 8 122432<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">VRF bit-map : 5 8 120 5 120<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">VRF : 1 216 216 1 216<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Vector index : 31049 variable 986696 31053 986936<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Vector : 31049 24 746440 31053 746536<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Typed-heap array : 1 576 584 1 584<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Typed-hash bucket : 21 variable 20982136 21 20982136<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Thread stats : 33 96 3464 33 3464<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Thread Poll Info : 6 8192 49200 6 49200<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Thread master : 12 variable 50352 12 50352<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Thread : 62 160 10608 358 63184<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route node : 14 120 1760 14 1760<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route table : 114 56 6464 114 6464<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Stream FIFO : 50 64 3600 54 3888<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Stream : 17 variable 733416 111502 20790624<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Socket union : 28 112 3376 38 4576<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Skiplist Counters : 2 68 144 2 144<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Skip Node : 2 160 336 2 336<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Skip List : 2 56 112 2 112<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map dependency data : 15 16 408 15 408<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map dependency : 9 24 232 9 232<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map compiled : 103 variable 2488 103 2488<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map rule str : 80 variable 1920 80 1920<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map rule : 81 40 3304 81 3304<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map index : 36 152 5600 36 5600<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map name : 31 variable 744 32 768<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Route map : 7 120 840 7 840<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Ring buffer : 50 variable 2458800 54 2655504<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Privilege information : 3 variable 136 3 136<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Prefix : 3 56 168 3 168<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Prefix List Trie Table : 1 4096 4104 1 4104<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Prefix List Entry : 1 136 136 1 136<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Prefix List Str : 1 16 24 1 24<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Prefix List : 1 88 88 1 88<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Northbound Configuration Entry: 127 1032 131064 127 131064<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Northbound Configuration : 2 24 48 2 48<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Northbound Node : 258 1192 307536 258 307536<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Nexthop : 38 152 5824 40 6128<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Module loading name : 1 5 24 1 24<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Bitfield memory : 2 variable 10256 2 10256<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Temporary memory : 134 variable 6816 142 11464<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Link Node : 465 24 11192 597 14360<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Link List : 62 40 2560 70 2888<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Connected : 3 48 168 3 168<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Interface : 2 272 560 2 560<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">ID Number Allocator Page : 2095 144 318760 2095 318760<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">ID Number Allocator Subdirectory: 17 1024 17544 17 17544<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">ID Number Allocator Directory : 2 1024 2064 2 2064<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">ID Number Allocator Name : 2 46 112 2 112<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">ID Number Allocator : 2 2072 4144 2 4144<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hash Index : 304 variable 29533992 309 33204032<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hash Bucket : 2246772 32 90014592 3116603 125184800<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hash : 607 variable 29816 615 30200<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Graph Node : 15481 32 621368 15483 621448<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Graph : 42 8 1008 43 1032<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">POSIX sync primitives : 4 variable 192 4 192<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">FRR POSIX Thread : 4 variable 320 4 320<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">RCU thread : 2 128 272 2 272<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Lexer token (temporary) : 0 variable 0 2 64<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Command Argument Name : 2294 variable 55088 2302 55280<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Command Argument : 2 variable 48 10 272<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Command Token Help : 9423 variable 227176 9431 227368<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Command Token Text : 9423 variable 328904 9431 329320<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Command Tokens : 13159 72 948184 13167 948776<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Host config : 7 variable 280 7 280<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Buffer data : 2 variable 8240 107564 443170128<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Buffer : 6 24 144 10 240<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">--- qmem rfapi ---<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Type : Current# Size Total Max# MaxBytes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">RFAPI Import Table : 1 208 216 1 216<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">RFAPI Generic : 1 296 296 1 296<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">NVE Configuration : 1 2984 2984 1 2984<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">--- qmem bgpd ---<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Type : Current# Size Total Max# MaxBytes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP EVPN instance information : 1 56 56 1 56<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP interface context : 2 4 48 2 48<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP PBR Context : 1 32 40 1 40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP Martian Addr Intf String : 2 7 48 2 48<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Software Version : 2 16 48 2 48<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP EVPN MH Information : 1 56 72 1 72<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP Filter Information : 22 variable 528 23 552<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP redistribution : 2 24 48 2 48<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP own address : 2 64 144 2 144<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP Dampening array : 3 variable 11928 3 11928<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP nexthop : 26 184 4816 26 4816<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP Process queue : 0 32 0 112 4480<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Cluster list val : 1 4 24 1 24<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Cluster list : 1 24 24 1 24<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">community-list handler : 1 120 136 1 136<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">extcommunity str : 3 66 216 3 216<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">extcommunity val : 3 8 72 4 96<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">extcommunity : 3 40 120 4 176<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">community str : 4 8192 32800 4 32800<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">community val : 31 variable 744 32 768<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">community : 31 40 1352 32 1408<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP multipath info : 1886967 48 110401272 1886967 110401272<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP adj out : 4371630 96 460084352 6599386 694406576<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP adj in : 4287743 48 276474536 4287743 276474536<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP synchronise : 6 48 384 10 608<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP adv : 0 64 0 5086993 366586872<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP adv attr : 0 24 0 888383 21587624<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP connected : 2 4 48 2 48<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP ancillary route info : 2143869 432 943368808 2143869 943368808<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP route : 2143879 136 303155384 2143879 303155384<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP node : 2056049 192 411343880 2056049 411343880<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP table : 87 56 4872 87 4872<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP aspath str : 263979 variable 17160632 263980 17161296<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP aspath segment data : 264217 variable 6923800 264219 6924032<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP aspath seg : 264217 24 6341224 264219 6341272<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP aspath : 263979 40 10559384 263979 10559384<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP attribute : 1980081 320 649651544 1980082 649651872<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP packet : 6 56 336 200 11488<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP update subgroup : 6 240 1488 10 2496<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP update group : 6 104 624 8 832<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP peer af : 24 80 2112 26 2288<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Peer description : 24 variable 576 24 576<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP peer hostname : 34 variable 976 39 1128<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP peer : 31 20864 647032 35 730536<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP listen socket details : 2 144 304 2 304<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP instance : 27 variable 10808 27 10808<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Mac Hash Entry Intf String : 2 variable 48 3 72<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Mac Hash Entry : 2 16 48 2 48<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP Peer pthread Mutex : 1 40 40 1 40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP Peer pthread Conditional : 1 48 56 1 56<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Peer KeepAlive Timer : 14 24 336 18 432<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP RPKI Revalidation : 0 variable 0 294 7056<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP RPKI RTRLib : 1253742 variable 50862160 2507300 111937728<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP RPKI Cache server group : 0 48 0 1 56<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">BGP RPKI Cache server : 12 variable 640 12 640<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> Donald Sharp <donaldsharp72@gmail.com>
<br>
<b>Sent:</b> Thursday, 28 September 2023 18:37<br>
<b>To:</b> Chris Knipe <savage@savage.za.org><br>
<b>Cc:</b> frog@lists.frrouting.org<br>
<b>Subject:</b> Re: [FROG] RPKI, this is getting a bit frustrating<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Can I see the output of `show memory` for bgpd? I'm not aware of any memory leaks in rpki( but that does not mean that they don't exist ). I'd also like to see the output of the rpki section of a show run.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">donald<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Thu, Sep 28, 2023 at 12:33 PM Chris Knipe via frog <<a href="mailto:frog@lists.frrouting.org">frog@lists.frrouting.org</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal"><br>
<br>
<br>
---------- Forwarded message ----------<br>
From: Chris Knipe <<a href="mailto:savage@savage.za.org" target="_blank">savage@savage.za.org</a>><br>
To: "<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
Cc: <br>
Bcc: <br>
Date: Thu, 28 Sep 2023 15:24:21 +0000<br>
Subject: RPKI, this is getting a bit frustrating<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Hi All,</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Been battling with this one now for a while, through a few different versions, and I am pulling my hair out here…. Is there any memory leaks in RPKI???</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">My RPKI config:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">rpki</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">rpki cache 172.65.0.2 8282 preference 1</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">rpki cache 172.65.0.2 8283 preference 2</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">exit</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Nothing more, nothing less. RPKI is (not yet) used in any route-maps, policies, etc.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">RPKI works absolutely fine. However, when I start bgpd, it has a resident memory size of ~3.6G (fine, considering it’s loading multiple full tables for IPv4
& ipv6). When RPKI isn’t configured, the router is stable, and memory usage is consistent and constant at ~3.6GB.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">However, as soon as RPKI is enabled, bgpd grows about 600MB in resident memory per day. Eventually, the system runs out of memory and bgpd is restarted (which,
is obviously bad).</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">root@MY-LOC-RS01A:~# ps auxxw|grep bgpd</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">root 802 0.0 0.0 8784 2844 ? S<s Sep26 1:02 /usr/lib/frr/watchfrr -d -F traditional zebra mgmtd bgpd ospfd ospf6d staticd</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">frr 850 16.8 54.7 4656684 4429752 ? S<sl Sep26 547:23 /usr/lib/frr/bgpd -d -F traditional -A 127.0.0.1 -M rpki -e 10</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">root 12813 0.0 0.0 6608 2312 pts/2 S+ 17:21 0:00 grep --color=auto bgpd</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">We’re already at 4.6GB up from 3.6GB when BGP has initially started (2d uptime for the longest BGP peer – see below).</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">FRR version, and IPv4 BGP Peers (with prefixes):</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">ZA-CTN-RS01A# sh ver</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">FRRouting 9.0.1 (MY-LOC-RS01A) on Linux(5.15.0-84-generic).</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Copyright 1996-2005 Kunihiro Ishiguro, et al.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">configured with:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=${prefix}/include' '--mandir=${prefix}/share/man' '--infodir=${prefix}/share/info' '--sysconfdir=/etc'
'--localstatedir=/var' '--disable-option-checking' '--disable-silent-rules' '--libdir=${prefix}/lib/x86_64-linux-gnu' '--libexecdir=${prefix}/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--localstatedir=/var/run/frr' '--sbindir=/usr/lib/frr' '--sysconfdir=/etc/frr'
'--with-vtysh-pager=/usr/bin/pager' '--libdir=/usr/lib/x86_64-linux-gnu/frr' '--with-moduledir=/usr/lib/x86_64-linux-gnu/frr/modules' '--disable-dependency-tracking' '--enable-rpki' '--disable-scripting' '--enable-pim6d' '--with-libpam' '--enable-doc' '--enable-doc-html'
'--enable-snmp' '--enable-fpm' '--disable-protobuf' '--disable-zeromq' '--enable-ospfapi' '--enable-bgp-vnc' '--enable-multipath=256' '--enable-user=frr' '--enable-group=frr' '--enable-vty-group=frrvty' '--enable-configfile-mask=0640' '--enable-logfile-mask=0640'
'build_alias=x86_64-linux-gnu' 'PYTHON=python3'</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">IPv4 Unicast Summary (VRF default):</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">BGP router identifier aaa.bbb.112.164, local AS number xxxxxx vrf-id 0</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">BGP table version 8318219</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">RIB entries 1693671, using 310 MiB of memory</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Peers 12, using 245 KiB of memory</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Dampening enabled.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt Desc</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.165 4 xxxxxx 723094 1164605 8318219 0 0 2d05h58m 4 1665344 MY-LOC-RS01B</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.240 4 xxxxxx 265406 743205 8318219 0 0 2d05h58m 835450 922653 MY-LOC-TR01A</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.241 4 xxxxxx 156145 763504 8318219 0 0 2d05h58m 603608 922653 MY-LOC-TR01B</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.242 4 xxxxxx 26776 761874 8318219 0 0 2d05h58m 113141 922653 MY-LOC-PR01A</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.243 4 xxxxxx 37609 761874 8318219 0 0 2d05h58m 113141 922653 MY-LOC-PR01B</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.244 4 xxxxxx 3241 745167 8318219 0 0 2d05h58m 0 922653 MY-LOC-CR01A</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.245 4 xxxxxx 3241 743205 8318219 0 0 2d05h58m 0 922653 MY-LOC-CR01B</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.248 4 xxxxxx 384 436702 8318219 0 0 06:16:02 0 922653 MY-LOC-IKE01A</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.112.249 4 xxxxxx 381 306758 8318219 0 0 06:18:32 0 922653 MY-LOC-IKE01B</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.113.151 4 xxxxxx 0 0 0 0 0 never Active 0 MY-LOC-RS01A</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">aaa.bbb.113.152 4 xxxxxx 0 0 0 0 0 never Active 0 MY-LOC-RS01B</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Total number of neighbors 11</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Thanks,</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Chris.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><br>
<br>
<br>
---------- Forwarded message ----------<br>
From: Chris Knipe via frog <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
To: "<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
Cc: <br>
Bcc: <br>
Date: Thu, 28 Sep 2023 15:24:21 +0000<br>
Subject: [FROG] RPKI, this is getting a bit frustrating<br>
_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" target="_blank">https://lists.frrouting.org/listinfo/frog</a><o:p></o:p></p>
</div>
</blockquote>
</div>
</div>
</body>
</html>