<div dir="ltr">Can I see the output of `show memory` for bgpd? I'm not aware of any memory leaks in rpki( but that does not mean that they don't exist ). I'd also like to see the output of the rpki section of a show run.<div><br></div><div>donald</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Sep 28, 2023 at 12:33 PM Chris Knipe via frog <<a href="mailto:frog@lists.frrouting.org">frog@lists.frrouting.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg3205542859922434900"><br><br><br>---------- Forwarded message ----------<br>From: Chris Knipe <<a href="mailto:savage@savage.za.org" target="_blank">savage@savage.za.org</a>><br>To: "<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>Cc: <br>Bcc: <br>Date: Thu, 28 Sep 2023 15:24:21 +0000<br>Subject: RPKI, this is getting a bit frustrating<br>
<div lang="EN-ZA" style="overflow-wrap: break-word;">
<div class="m_3205542859922434900WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi All,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Been battling with this one now for a while, through a few different versions, and I am pulling my hair out here…. Is there any memory leaks in RPKI???<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">My RPKI config:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">rpki<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">rpki cache 172.65.0.2 8282 preference 1<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">rpki cache 172.65.0.2 8283 preference 2<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">exit<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Nothing more, nothing less. RPKI is (not yet) used in any route-maps, policies, etc.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">RPKI works absolutely fine. However, when I start bgpd, it has a resident memory size of ~3.6G (fine, considering it’s loading multiple full tables for IPv4 & ipv6). When RPKI isn’t configured, the router is stable,
and memory usage is consistent and constant at ~3.6GB.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">However, as soon as RPKI is enabled, bgpd grows about 600MB in resident memory per day. Eventually, the system runs out of memory and bgpd is restarted (which, is obviously bad).<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">root@MY-LOC-RS01A:~# ps auxxw|grep bgpd<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">root 802 0.0 0.0 8784 2844 ? S<s Sep26 1:02 /usr/lib/frr/watchfrr -d -F traditional zebra mgmtd bgpd ospfd ospf6d staticd<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">frr 850 16.8 54.7 4656684 4429752 ? S<sl Sep26 547:23 /usr/lib/frr/bgpd -d -F traditional -A 127.0.0.1 -M rpki -e 10<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">root 12813 0.0 0.0 6608 2312 pts/2 S+ 17:21 0:00 grep --color=auto bgpd<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">We’re already at 4.6GB up from 3.6GB when BGP has initially started (2d uptime for the longest BGP peer – see below).<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">FRR version, and IPv4 BGP Peers (with prefixes):<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">ZA-CTN-RS01A# sh ver<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">FRRouting 9.0.1 (MY-LOC-RS01A) on Linux(5.15.0-84-generic).<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Copyright 1996-2005 Kunihiro Ishiguro, et al.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">configured with:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=${prefix}/include' '--mandir=${prefix}/share/man' '--infodir=${prefix}/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-option-checking' '--disable-silent-rules'
'--libdir=${prefix}/lib/x86_64-linux-gnu' '--libexecdir=${prefix}/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--localstatedir=/var/run/frr' '--sbindir=/usr/lib/frr' '--sysconfdir=/etc/frr' '--with-vtysh-pager=/usr/bin/pager' '--libdir=/usr/lib/x86_64-linux-gnu/frr'
'--with-moduledir=/usr/lib/x86_64-linux-gnu/frr/modules' '--disable-dependency-tracking' '--enable-rpki' '--disable-scripting' '--enable-pim6d' '--with-libpam' '--enable-doc' '--enable-doc-html' '--enable-snmp' '--enable-fpm' '--disable-protobuf' '--disable-zeromq'
'--enable-ospfapi' '--enable-bgp-vnc' '--enable-multipath=256' '--enable-user=frr' '--enable-group=frr' '--enable-vty-group=frrvty' '--enable-configfile-mask=0640' '--enable-logfile-mask=0640' 'build_alias=x86_64-linux-gnu' 'PYTHON=python3'<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">IPv4 Unicast Summary (VRF default):<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">BGP router identifier aaa.bbb.112.164, local AS number xxxxxx vrf-id 0<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">BGP table version 8318219<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">RIB entries 1693671, using 310 MiB of memory<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Peers 12, using 245 KiB of memory<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Dampening enabled.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt Desc<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.165 4 xxxxxx 723094 1164605 8318219 0 0 2d05h58m 4 1665344 MY-LOC-RS01B<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.240 4 xxxxxx 265406 743205 8318219 0 0 2d05h58m 835450 922653 MY-LOC-TR01A<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.241 4 xxxxxx 156145 763504 8318219 0 0 2d05h58m 603608 922653 MY-LOC-TR01B<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.242 4 xxxxxx 26776 761874 8318219 0 0 2d05h58m 113141 922653 MY-LOC-PR01A<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.243 4 xxxxxx 37609 761874 8318219 0 0 2d05h58m 113141 922653 MY-LOC-PR01B<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.244 4 xxxxxx 3241 745167 8318219 0 0 2d05h58m 0 922653 MY-LOC-CR01A<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.245 4 xxxxxx 3241 743205 8318219 0 0 2d05h58m 0 922653 MY-LOC-CR01B<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.248 4 xxxxxx 384 436702 8318219 0 0 06:16:02 0 922653 MY-LOC-IKE01A<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.112.249 4 xxxxxx 381 306758 8318219 0 0 06:18:32 0 922653 MY-LOC-IKE01B<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.113.151 4 xxxxxx 0 0 0 0 0 never Active 0 MY-LOC-RS01A<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">aaa.bbb.113.152 4 xxxxxx 0 0 0 0 0 never Active 0 MY-LOC-RS01B<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Total number of neighbors 11<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Thanks,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Chris.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
</div>
<br><br><br>---------- Forwarded message ----------<br>From: Chris Knipe via frog <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>To: "<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>Cc: <br>Bcc: <br>Date: Thu, 28 Sep 2023 15:24:21 +0000<br>Subject: [FROG] RPKI, this is getting a bit frustrating<br>_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" rel="noreferrer" target="_blank">https://lists.frrouting.org/listinfo/frog</a><br>
</div></blockquote></div>