<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
@font-face
{font-family:"Segoe UI Emoji";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Thanks Donald. I ran ip monitor, and it showed the del/add’s, but not what was causing it.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I downgraded both frr and NetworkManager to no avail. I downgraded NM again, and now the issue seems to not be occurring. So I’m still not sure why, but thanks to you I know it’s not normal, and that the
culprit lies somewhere in either NetworkManager, or in my configuration of it. I’ll upgrade frr back to current, and then start investigating more. I’d suspect it’s NM that’s doing this for reasons unknown (I’ll start a trace and/or open a ticket with RH)date<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I don’t remember and have my notes in front of me of when I first set up frr, but I didn’t have a lot of resources to learn against when I did. I fumbled through a bit of configs, and remember not being able
to use loopback (like we did with quagga), and not being able to use frr without defining the IPs somewhere at the OS level (and since RHEL moved away from the network-scripts configs, NM was my only logical option). I had read to use a dummy device, and
add IPs to it (with method: manual). That seemed to work, and similar to quagga (except the IPs were on lo0) in that both the OS and FRR seemed to want to define the IPs.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">[root@redacted:~]# nmcli con<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">NAME UUID TYPE DEVICE<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">ens192 8d7fe6b4-da89-4095-90d7-f2a7d72de5d2 ethernet ens192<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">services 5de48daf-c2b0-401a-950a-94ce0d7a0b05 dummy services<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">lo 610d9dba-d14d-430c-898b-8b1c7b84838c loopback lo<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I guess the trick is to either find a bug in NM, or to somehow tell it to stop messing with that dummy interface…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Ian<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Donald Sharp <donaldsharp72@gmail.com>
<br>
<b>Sent:</b> Friday, July 5, 2024 4:30 PM<br>
<b>To:</b> Ian Veach <iveach@nshe.nevada.edu><br>
<b>Cc:</b> frog@lists.frrouting.org<br>
<b>Subject:</b> Re: [FROG] looking for expert opinion on whether this is normal<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p><span style="font-family:"Segoe UI Emoji",sans-serif;color:black;background:red">⚠</span><span style="color:black;background:#FFCC00"> External Email: </span><o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">Something is deleting and then re-adding back the ip address assigned to the interface that
<a href="http://10.10.205.4/32">10.10.205.4/32</a> is applied to. You should be able to see that with a `ip monitor address`. There is nothing in FRR that does this type of activity so I cannot guess as to what is causing this to happen.
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">donald<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Fri, Jul 5, 2024 at 3:37<span style="font-family:"Arial",sans-serif"> </span>PM Ian Veach <<a href="mailto:iveach@nshe.nevada.edu">iveach@nshe.nevada.edu</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">We’re tracking down something that might be an issue – we’re not sure. We don’t normally run frr with all debug logging turned on, and don’t know if this behavior is normal or
not (we don’t have much to compare it to).<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Every 30 seconds, with logging on, we see this in the logs (for each interface with route):<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">2024 Jul 5 11:31:41 hostredacted [daemon.debug] ospfd[960266]: [JZFS1-TNQFD] Zebra: interface services address delete
<a href="http://10.10.205.4/32" target="_blank">10.10.205.4/32</a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">2024 Jul 5 11:31:41 hostredacted [daemon.debug] ospfd[960266]: [PH9HB-NQMHW] Zebra: interface services address add
<a href="http://10.10.205.4/32" target="_blank">10.10.205.4/32</a> vrf default id 0<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">It seems like this is flapping the interface to us, but maybe it’s a normal part of frr internals to do so? Is this normal for frr to delete and add the interface every 30 seconds?<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Functionally, OSPF and our anycast DNS seems to be running ok. But our monitoring has missed some pings (which could be explained with the interface delete/add).<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">(this is on rhel9, frr-8.5.3-4, although I also get the same behavior when I downgrade to frr-8.3.1-11)<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thank you for any input!<o:p></o:p></p>
</div>
<p class="MsoNormal">PUBLIC RECORDS NOTICE: In accordance with NRS Chapter 239, this email and responses, unless otherwise made confidential by law, may be subject to the Nevada Public Records laws and may be disclosed to the public upon request.
<o:p></o:p></p>
</div>
<p class="MsoNormal">_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" target="_blank">https://lists.frrouting.org/listinfo/frog</a><o:p></o:p></p>
</div>
</blockquote>
</div>
</div>
</div>
</body>
</html>