<div dir="ltr">Can we wait a couple hours and regrab the memory for bgp? I'd like to see where it is growing. As of now I'm not convinced it's rpki. I just turned on rpki (again!) on my home full feed. I'll keep an eye on it as well.<div><br></div><div>donald</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Sep 28, 2023 at 1:07 PM Chris Knipe <<a href="mailto:savage@savage.za.org">savage@savage.za.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg-7499235328205885463">
<div lang="EN-ZA" style="overflow-wrap: break-word;">
<div class="m_-7499235328205885463WordSection1">
<p class="MsoNormal"><span>Hi Donald,<u></u><u></u></span></p>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<p class="MsoNormal"><span>RPKI config literally is only (CloudFlare RPKI Server):<u></u><u></u></span></p>
<p class="MsoNormal"><span>rpki<u></u><u></u></span></p>
<p class="MsoNormal"><span>rpki cache 172.65.0.2 8282 preference 1<u></u><u></u></span></p>
<p class="MsoNormal"><span>rpki cache 172.65.0.2 8283 preference 2<u></u><u></u></span></p>
<p class="MsoNormal"><span>exit<u></u><u></u></span></p>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<p class="MsoNormal"><span>sh memory bgpd:<u></u><u></u></span></p>
<p class="MsoNormal"><span>System allocator statistics:<u></u><u></u></span></p>
<p class="MsoNormal"><span> Total heap allocated: > 2GB<u></u><u></u></span></p>
<p class="MsoNormal"><span> Holding block headers: 36 MiB<u></u><u></u></span></p>
<p class="MsoNormal"><span> Used small blocks: 0 bytes<u></u><u></u></span></p>
<p class="MsoNormal"><span> Used ordinary blocks: > 2GB<u></u><u></u></span></p>
<p class="MsoNormal"><span> Free small blocks: 4960 bytes<u></u><u></u></span></p>
<p class="MsoNormal"><span> Free ordinary blocks: 785 MiB<u></u><u></u></span></p>
<p class="MsoNormal"><span> Ordinary blocks: 1400129<u></u><u></u></span></p>
<p class="MsoNormal"><span> Small blocks: 122<u></u><u></u></span></p>
<p class="MsoNormal"><span> Holding blocks: 3<u></u><u></u></span></p>
<p class="MsoNormal"><span>(see system documentation for 'mallinfo' for meaning)<u></u><u></u></span></p>
<p class="MsoNormal"><span>--- qmem logging subsystem ---<u></u><u></u></span></p>
<p class="MsoNormal"><span>Type : Current# Size Total Max# MaxBytes<u></u><u></u></span></p>
<p class="MsoNormal"><span>syslog target : 1 56 56 1 56<u></u><u></u></span></p>
<p class="MsoNormal"><span>--- qmem libfrr ---<u></u><u></u></span></p>
<p class="MsoNormal"><span>Type : Current# Size Total Max# MaxBytes<u></u><u></u></span></p>
<p class="MsoNormal"><span>log thread-local buffer : 2 24608 49232 2 49232<u></u><u></u></span></p>
<p class="MsoNormal"><span>Redistribution instance IDs : 6 2 144 6 144<u></u><u></u></span></p>
<p class="MsoNormal"><span>Zclient : 2 3144 6288 2 6288<u></u><u></u></span></p>
<p class="MsoNormal"><span>YANG data structure : 0 1032 0 1 1032<u></u><u></u></span></p>
<p class="MsoNormal"><span>YANG module : 5 48 296 5 296<u></u><u></u></span></p>
<p class="MsoNormal"><span>Work queue name string : 5 variable 136 6 176<u></u><u></u></span></p>
<p class="MsoNormal"><span>Work queue item : 0 24 0 112 2688<u></u><u></u></span></p>
<p class="MsoNormal"><span>Work queue : 5 144 760 6 912<u></u><u></u></span></p>
<p class="MsoNormal"><span>VTY server : 2 32 80 2 80<u></u><u></u></span></p>
<p class="MsoNormal"><span>VTY : 4 variable 61216 8 122432<u></u><u></u></span></p>
<p class="MsoNormal"><span>VRF bit-map : 5 8 120 5 120<u></u><u></u></span></p>
<p class="MsoNormal"><span>VRF : 1 216 216 1 216<u></u><u></u></span></p>
<p class="MsoNormal"><span>Vector index : 31049 variable 986696 31053 986936<u></u><u></u></span></p>
<p class="MsoNormal"><span>Vector : 31049 24 746440 31053 746536<u></u><u></u></span></p>
<p class="MsoNormal"><span>Typed-heap array : 1 576 584 1 584<u></u><u></u></span></p>
<p class="MsoNormal"><span>Typed-hash bucket : 21 variable 20982136 21 20982136<u></u><u></u></span></p>
<p class="MsoNormal"><span>Thread stats : 33 96 3464 33 3464<u></u><u></u></span></p>
<p class="MsoNormal"><span>Thread Poll Info : 6 8192 49200 6 49200<u></u><u></u></span></p>
<p class="MsoNormal"><span>Thread master : 12 variable 50352 12 50352<u></u><u></u></span></p>
<p class="MsoNormal"><span>Thread : 71 160 12136 358 63184<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route node : 14 120 1760 14 1760<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route table : 114 56 6464 114 6464<u></u><u></u></span></p>
<p class="MsoNormal"><span>Stream FIFO : 50 64 3600 54 3888<u></u><u></u></span></p>
<p class="MsoNormal"><span>Stream : 21 variable 752024 111502 20790624<u></u><u></u></span></p>
<p class="MsoNormal"><span>Socket union : 36 112 4336 38 4576<u></u><u></u></span></p>
<p class="MsoNormal"><span>Skiplist Counters : 2 68 144 2 144<u></u><u></u></span></p>
<p class="MsoNormal"><span>Skip Node : 2 160 336 2 336<u></u><u></u></span></p>
<p class="MsoNormal"><span>Skip List : 2 56 112 2 112<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map dependency data : 15 16 408 15 408<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map dependency : 9 24 232 9 232<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map compiled : 103 variable 2488 103 2488<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map rule str : 80 variable 1920 80 1920<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map rule : 81 40 3304 81 3304<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map index : 36 152 5600 36 5600<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map name : 31 variable 744 32 768<u></u><u></u></span></p>
<p class="MsoNormal"><span>Route map : 7 120 840 7 840<u></u><u></u></span></p>
<p class="MsoNormal"><span>Ring buffer : 50 variable 2458800 54 2655504<u></u><u></u></span></p>
<p class="MsoNormal"><span>Privilege information : 3 variable 136 3 136<u></u><u></u></span></p>
<p class="MsoNormal"><span>Prefix : 3 56 168 3 168<u></u><u></u></span></p>
<p class="MsoNormal"><span>Prefix List Trie Table : 1 4096 4104 1 4104<u></u><u></u></span></p>
<p class="MsoNormal"><span>Prefix List Entry : 1 136 136 1 136<u></u><u></u></span></p>
<p class="MsoNormal"><span>Prefix List Str : 1 16 24 1 24<u></u><u></u></span></p>
<p class="MsoNormal"><span>Prefix List : 1 88 88 1 88<u></u><u></u></span></p>
<p class="MsoNormal"><span>Northbound Configuration Entry: 127 1032 131064 127 131064<u></u><u></u></span></p>
<p class="MsoNormal"><span>Northbound Configuration : 2 24 48 2 48<u></u><u></u></span></p>
<p class="MsoNormal"><span>Northbound Node : 258 1192 307536 258 307536<u></u><u></u></span></p>
<p class="MsoNormal"><span>Nexthop : 36 152 5536 38 5856<u></u><u></u></span></p>
<p class="MsoNormal"><span>Module loading name : 1 5 24 1 24<u></u><u></u></span></p>
<p class="MsoNormal"><span>Bitfield memory : 2 variable 10256 2 10256<u></u><u></u></span></p>
<p class="MsoNormal"><span>Temporary memory : 134 variable 6816 142 11464<u></u><u></u></span></p>
<p class="MsoNormal"><span>Link Node : 465 24 11192 597 14360<u></u><u></u></span></p>
<p class="MsoNormal"><span>Link List : 62 40 2560 70 2888<u></u><u></u></span></p>
<p class="MsoNormal"><span>Connected : 3 48 168 3 168<u></u><u></u></span></p>
<p class="MsoNormal"><span>Interface : 2 272 560 2 560<u></u><u></u></span></p>
<p class="MsoNormal"><span>ID Number Allocator Page : 2095 144 318760 2095 318760<u></u><u></u></span></p>
<p class="MsoNormal"><span>ID Number Allocator Subdirectory: 17 1024 17544 17 17544<u></u><u></u></span></p>
<p class="MsoNormal"><span>ID Number Allocator Directory : 2 1024 2064 2 2064<u></u><u></u></span></p>
<p class="MsoNormal"><span>ID Number Allocator Name : 2 46 112 2 112<u></u><u></u></span></p>
<p class="MsoNormal"><span>ID Number Allocator : 2 2072 4144 2 4144<u></u><u></u></span></p>
<p class="MsoNormal"><span>Hash Index : 306 variable 32155448 309 33204032<u></u><u></u></span></p>
<p class="MsoNormal"><span>Hash Bucket : 2231959 32 89416248 3116603 125184800<u></u><u></u></span></p>
<p class="MsoNormal"><span>Hash : 611 variable 30008 615 30200<u></u><u></u></span></p>
<p class="MsoNormal"><span>Graph Node : 15481 32 621368 15483 621448<u></u><u></u></span></p>
<p class="MsoNormal"><span>Graph : 42 8 1008 43 1032<u></u><u></u></span></p>
<p class="MsoNormal"><span>POSIX sync primitives : 4 variable 192 4 192<u></u><u></u></span></p>
<p class="MsoNormal"><span>FRR POSIX Thread : 4 variable 320 4 320<u></u><u></u></span></p>
<p class="MsoNormal"><span>RCU thread : 2 128 272 2 272<u></u><u></u></span></p>
<p class="MsoNormal"><span>Lexer token (temporary) : 0 variable 0 2 64<u></u><u></u></span></p>
<p class="MsoNormal"><span>Command Argument Name : 2294 variable 55088 2302 55280<u></u><u></u></span></p>
<p class="MsoNormal"><span>Command Argument : 2 variable 48 10 272<u></u><u></u></span></p>
<p class="MsoNormal"><span>Command Token Help : 9423 variable 227176 9431 227368<u></u><u></u></span></p>
<p class="MsoNormal"><span>Command Token Text : 9423 variable 328904 9431 329320<u></u><u></u></span></p>
<p class="MsoNormal"><span>Command Tokens : 13159 72 948184 13167 948776<u></u><u></u></span></p>
<p class="MsoNormal"><span>Host config : 7 variable 280 7 280<u></u><u></u></span></p>
<p class="MsoNormal"><span>Buffer data : 2 variable 8240 107564 443170128<u></u><u></u></span></p>
<p class="MsoNormal"><span>Buffer : 6 24 144 10 240<u></u><u></u></span></p>
<p class="MsoNormal"><span>--- qmem rfapi ---<u></u><u></u></span></p>
<p class="MsoNormal"><span>Type : Current# Size Total Max# MaxBytes<u></u><u></u></span></p>
<p class="MsoNormal"><span>RFAPI Import Table : 1 208 216 1 216<u></u><u></u></span></p>
<p class="MsoNormal"><span>RFAPI Generic : 1 296 296 1 296<u></u><u></u></span></p>
<p class="MsoNormal"><span>NVE Configuration : 1 2984 2984 1 2984<u></u><u></u></span></p>
<p class="MsoNormal"><span>--- qmem bgpd ---<u></u><u></u></span></p>
<p class="MsoNormal"><span>Type : Current# Size Total Max# MaxBytes<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP EVPN instance information : 1 56 56 1 56<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP interface context : 2 4 48 2 48<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP PBR Context : 1 32 40 1 40<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP Martian Addr Intf String : 2 7 48 2 48<u></u><u></u></span></p>
<p class="MsoNormal"><span>Software Version : 2 16 48 2 48<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP EVPN MH Information : 1 56 72 1 72<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP Filter Information : 22 variable 528 23 552<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP redistribution : 2 24 48 2 48<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP own address : 2 64 144 2 144<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP Dampening array : 3 variable 11928 3 11928<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP nexthop : 26 184 4816 26 4816<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP Process queue : 0 32 0 112 4480<u></u><u></u></span></p>
<p class="MsoNormal"><span>Cluster list val : 1 4 24 1 24<u></u><u></u></span></p>
<p class="MsoNormal"><span>Cluster list : 1 24 24 1 24<u></u><u></u></span></p>
<p class="MsoNormal"><span>community-list handler : 1 120 136 1 136<u></u><u></u></span></p>
<p class="MsoNormal"><span>extcommunity str : 3 66 216 3 216<u></u><u></u></span></p>
<p class="MsoNormal"><span>extcommunity val : 3 8 72 4 96<u></u><u></u></span></p>
<p class="MsoNormal"><span>extcommunity : 3 40 120 4 176<u></u><u></u></span></p>
<p class="MsoNormal"><span>community str : 4 8192 32800 4 32800<u></u><u></u></span></p>
<p class="MsoNormal"><span>community val : 31 variable 744 32 768<u></u><u></u></span></p>
<p class="MsoNormal"><span>community : 31 40 1352 32 1408<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP multipath info : 1886967 48 110401272 1886967 110401272<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP adj out : 5485508 96 578004240 6599386 694406576<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP adj in : 4287743 48 276474536 4287743 276474536<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP synchronise : 8 48 496 10 608<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP adv : 0 64 0 5086993 366586872<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP adv attr : 0 24 0 888383 21587624<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP connected : 2 4 48 2 48<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP ancillary route info : 2143869 432 943368808 2143869 943368808<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP route : 2143879 136 303155384 2143879 303155384<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP node : 2056049 192 411343880 2056049 411343880<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP table : 87 56 4872 87 4872<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP aspath str : 263979 variable 17160632 263980 17161296<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP aspath segment data : 264217 variable 6923800 264219 6924032<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP aspath seg : 264217 24 6341224 264219 6341272<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP aspath : 263979 40 10559384 263979 10559384<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP attribute : 1965262 320 644785312 1965262 644785312<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP packet : 8 56 448 200 11488<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP update subgroup : 8 240 1984 10 2496<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP update group : 8 104 832 8 832<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP peer af : 24 80 2112 26 2288<u></u><u></u></span></p>
<p class="MsoNormal"><span>Peer description : 24 variable 576 24 576<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP peer hostname : 36 variable 1040 39 1128<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP peer : 33 20864 688776 35 730536<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP listen socket details : 2 144 304 2 304<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP instance : 27 variable 10808 27 10808<u></u><u></u></span></p>
<p class="MsoNormal"><span>Mac Hash Entry Intf String : 2 variable 48 3 72<u></u><u></u></span></p>
<p class="MsoNormal"><span>Mac Hash Entry : 2 16 48 2 48<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP Peer pthread Mutex : 1 40 40 1 40<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP Peer pthread Conditional : 1 48 56 1 56<u></u><u></u></span></p>
<p class="MsoNormal"><span>Peer KeepAlive Timer : 18 24 432 18 432<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI Revalidation : 0 variable 0 294 7056<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI RTRLib : 1253160 variable 50842592 1253222 60981208<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI Cache server group : 0 48 0 1 56<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI Cache server : 12 variable 640 12 640<u></u><u></u></span></p>
<p class="MsoNormal"><span>ZA-CTN-RS01A# sh memory bgpd | grep RPKI<u></u><u></u></span></p>
<p class="MsoNormal"><span>% Unknown action 'grep'<u></u><u></u></span></p>
<p class="MsoNormal"><span>ZA-CTN-RS01A# sh memory bgpd | include RPKI<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI Revalidation : 0 variable 0 294 7056<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI RTRLib : 1253160 variable 50842592 1253222 60981208<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI Cache server group : 0 48 0 1 56<u></u><u></u></span></p>
<p class="MsoNormal"><span>BGP RPKI Cache server : 12 variable 640 12 640<u></u><u></u></span></p>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<p class="MsoNormal"><span>Regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span>Chris.<u></u><u></u></span></p>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> Donald Sharp <<a href="mailto:donaldsharp72@gmail.com" target="_blank">donaldsharp72@gmail.com</a>>
<br>
<b>Sent:</b> Thursday, 28 September 2023 18:37<br>
<b>To:</b> Chris Knipe <<a href="mailto:savage@savage.za.org" target="_blank">savage@savage.za.org</a>><br>
<b>Cc:</b> <a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<b>Subject:</b> Re: [FROG] RPKI, this is getting a bit frustrating<u></u><u></u></span></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Can I see the output of `show memory` for bgpd? I'm not aware of any memory leaks in rpki( but that does not mean that they don't exist ). I'd also like to see the output of the rpki section of a show run.<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">donald<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Thu, Sep 28, 2023 at 12:33 PM Chris Knipe via frog <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal"><br>
<br>
<br>
---------- Forwarded message ----------<br>
From: Chris Knipe <<a href="mailto:savage@savage.za.org" target="_blank">savage@savage.za.org</a>><br>
To: "<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
Cc: <br>
Bcc: <br>
Date: Thu, 28 Sep 2023 15:24:21 +0000<br>
Subject: RPKI, this is getting a bit frustrating<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Hi All,</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Been battling with this one now for a while, through a few different versions, and I am pulling my hair out here…. Is there any memory leaks in RPKI???</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">My RPKI config:</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">rpki</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">rpki cache 172.65.0.2 8282 preference 1</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">rpki cache 172.65.0.2 8283 preference 2</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">exit</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Nothing more, nothing less. RPKI is (not yet) used in any route-maps, policies, etc.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">RPKI works absolutely fine. However, when I start bgpd, it has a resident memory size of ~3.6G (fine, considering it’s loading multiple full tables for IPv4
& ipv6). When RPKI isn’t configured, the router is stable, and memory usage is consistent and constant at ~3.6GB.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">However, as soon as RPKI is enabled, bgpd grows about 600MB in resident memory per day. Eventually, the system runs out of memory and bgpd is restarted (which,
is obviously bad).</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">root@MY-LOC-RS01A:~# ps auxxw|grep bgpd</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">root 802 0.0 0.0 8784 2844 ? S<s Sep26 1:02 /usr/lib/frr/watchfrr -d -F traditional zebra mgmtd bgpd ospfd ospf6d staticd</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">frr 850 16.8 54.7 4656684 4429752 ? S<sl Sep26 547:23 /usr/lib/frr/bgpd -d -F traditional -A 127.0.0.1 -M rpki -e 10</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">root 12813 0.0 0.0 6608 2312 pts/2 S+ 17:21 0:00 grep --color=auto bgpd</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">We’re already at 4.6GB up from 3.6GB when BGP has initially started (2d uptime for the longest BGP peer – see below).</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">FRR version, and IPv4 BGP Peers (with prefixes):</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">ZA-CTN-RS01A# sh ver</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">FRRouting 9.0.1 (MY-LOC-RS01A) on Linux(5.15.0-84-generic).</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Copyright 1996-2005 Kunihiro Ishiguro, et al.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">configured with:</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=${prefix}/include' '--mandir=${prefix}/share/man' '--infodir=${prefix}/share/info' '--sysconfdir=/etc'
'--localstatedir=/var' '--disable-option-checking' '--disable-silent-rules' '--libdir=${prefix}/lib/x86_64-linux-gnu' '--libexecdir=${prefix}/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--localstatedir=/var/run/frr' '--sbindir=/usr/lib/frr' '--sysconfdir=/etc/frr'
'--with-vtysh-pager=/usr/bin/pager' '--libdir=/usr/lib/x86_64-linux-gnu/frr' '--with-moduledir=/usr/lib/x86_64-linux-gnu/frr/modules' '--disable-dependency-tracking' '--enable-rpki' '--disable-scripting' '--enable-pim6d' '--with-libpam' '--enable-doc' '--enable-doc-html'
'--enable-snmp' '--enable-fpm' '--disable-protobuf' '--disable-zeromq' '--enable-ospfapi' '--enable-bgp-vnc' '--enable-multipath=256' '--enable-user=frr' '--enable-group=frr' '--enable-vty-group=frrvty' '--enable-configfile-mask=0640' '--enable-logfile-mask=0640'
'build_alias=x86_64-linux-gnu' 'PYTHON=python3'</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">IPv4 Unicast Summary (VRF default):</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">BGP router identifier aaa.bbb.112.164, local AS number xxxxxx vrf-id 0</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">BGP table version 8318219</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">RIB entries 1693671, using 310 MiB of memory</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Peers 12, using 245 KiB of memory</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Dampening enabled.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt Desc</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.165 4 xxxxxx 723094 1164605 8318219 0 0 2d05h58m 4 1665344 MY-LOC-RS01B</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.240 4 xxxxxx 265406 743205 8318219 0 0 2d05h58m 835450 922653 MY-LOC-TR01A</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.241 4 xxxxxx 156145 763504 8318219 0 0 2d05h58m 603608 922653 MY-LOC-TR01B</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.242 4 xxxxxx 26776 761874 8318219 0 0 2d05h58m 113141 922653 MY-LOC-PR01A</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.243 4 xxxxxx 37609 761874 8318219 0 0 2d05h58m 113141 922653 MY-LOC-PR01B</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.244 4 xxxxxx 3241 745167 8318219 0 0 2d05h58m 0 922653 MY-LOC-CR01A</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.245 4 xxxxxx 3241 743205 8318219 0 0 2d05h58m 0 922653 MY-LOC-CR01B</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.248 4 xxxxxx 384 436702 8318219 0 0 06:16:02 0 922653 MY-LOC-IKE01A</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.249 4 xxxxxx 381 306758 8318219 0 0 06:18:32 0 922653 MY-LOC-IKE01B</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.113.151 4 xxxxxx 0 0 0 0 0 never Active 0 MY-LOC-RS01A</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.113.152 4 xxxxxx 0 0 0 0 0 never Active 0 MY-LOC-RS01B</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Total number of neighbors 11</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Thanks,</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Chris.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><br>
<br>
<br>
---------- Forwarded message ----------<br>
From: Chris Knipe via frog <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
To: "<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
Cc: <br>
Bcc: <br>
Date: Thu, 28 Sep 2023 15:24:21 +0000<br>
Subject: [FROG] RPKI, this is getting a bit frustrating<br>
_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" target="_blank">https://lists.frrouting.org/listinfo/frog</a><u></u><u></u></p>
</div>
</blockquote>
</div>
</div>
</div>
</div></blockquote></div>