<div dir="ltr">Don't forget looking at XDP if you are going down that path.<div><br></div><div>donald</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Feb 22, 2019 at 6:54 PM Matt Love <<a href="mailto:matt@oscloud.io">matt@oscloud.io</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US">
<div class="gmail-m_192716053946902544WordSection1">
<p class="MsoNormal">Hi Sim,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Depends on your performance requirements. Are you trying to push 10G+/14M PPS? If so, you probably want to look into VPP. VPP is a kernel bypass dataplane implementation that is supposed to drastically improve forwarding performance over
the Linux kernel. Decent info here: <a href="https://wiki.fd.io/view/VPP/What_is_VPP%3F" target="_blank">
https://wiki.fd.io/view/VPP/What_is_VPP%3F</a><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Matt Love<u></u><u></u></p>
<p class="MsoNormal">Sr. Network Engineer<u></u><u></u></p>
<p class="MsoNormal">Omnificent Systems Inc. | osCloud | AS14525<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From: </span></b><span style="font-size:12pt;color:black">Sim <<a href="mailto:simvirus@gmail.com" target="_blank">simvirus@gmail.com</a>><br>
<b>Date: </b>Friday, February 22, 2019 at 6:24 AM<br>
<b>To: </b>Matt Love <<a href="mailto:matt@oscloud.io" target="_blank">matt@oscloud.io</a>><br>
<b>Cc: </b>"<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
<b>Subject: </b>Re: [FROG] Hardware Requirements<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Hello Matt,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span class="gmail-m_192716053946902544gmail-">thanks for sharing your experience</span>.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I'm using Ubuntu 18.04 LTS + FRR + TC QoS (in VMware environment with two vNIC)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">First NIC is for "BORDER" and the secondo NIC is for "INTERIOR".<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">No-NAT, No-Firewall or No-other... only BGP/Routing.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmail-m_192716053946902544gmail-">Well... I do not know</span> VPP.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Could <span class="gmail-m_192716053946902544gmail-">you explain me</span> if it <span class="gmail-m_192716053946902544gmail-">
could be interesting in my infrastructure/config?</span> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Sim<u></u><u></u></p>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">Il giorno gio 21 feb 2019 alle ore 16:08 Matt Love <<a href="mailto:matt@oscloud.io" target="_blank">matt@oscloud.io</a>> ha scritto:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">Hello, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I’m currently in exactly the same boat. I spent a good bit of time getting VPP and FRRouting married on a SuperMicro chassis with 4x Intel X722 NICs. I have a loose collection of notes/instructions here:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><a href="https://github.com/checktheroads/x86-edgerouter" target="_blank">https://github.com/checktheroads/x86-edgerouter</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Ultimately we haven’t moved with this in production due to lack of faith in performance. I haven’t been able to prove that it’ll do 14M PPS to achieve line rate 10 Gbps, mainly because I don’t have a testing environment.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">But, in the mean time, feel free to peruse my docs, they should help you build a semi-reliable VPP/FRR setup.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt">Cheers<u></u><u></u></p>
<div id="gmail-m_192716053946902544gmail-m_793734529229439929AppleMailSignature">
<p style="margin:0in 0in 0.0001pt"><span style="font-size:12pt;font-family:Helvetica">Matt Love</span><span style="font-size:9pt;font-family:Helvetica"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt;font-stretch:normal"><span style="font-size:12pt;font-family:Helvetica">Sr. Network Engineer</span><span style="font-size:9pt;font-family:Helvetica"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt;font-stretch:normal"><span style="font-size:12pt;font-family:Helvetica">Omnificent Systems Inc. | osCloud | AS14525</span><span style="font-size:9pt;font-family:Helvetica"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt;font-stretch:normal;min-height:13.8px">
<span style="font-size:9pt;font-family:Helvetica"><u></u> <u></u></span></p>
<p style="margin:0in 0in 0.0001pt;font-stretch:normal"><span style="font-size:12pt;font-family:"Cambria Math",serif">⌁</span><span style="font-size:12pt;font-family:Helvetica"> Sent from Mobile</span><span style="font-size:9pt;font-family:Helvetica"><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><br>
On Feb 21, 2019, at 05:34, Steuer Heribert <<a href="mailto:steuer@patronas.com" target="_blank">steuer@patronas.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="margin-top:5pt;margin-bottom:5pt">
<div>
<div>
<p class="MsoNormal">Hello Donald,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">thanks for your reply. I think it would be quite useful for users to have an overview of proven hardware setups. Control-plane is finally just one part of the game. We finally want
to replace some<u></u><u></u></p>
<p class="MsoNormal">old Cisco edge routers with a handful of BGP peers (all full table) for IPv4 and IPv6. Bandwidth per port does not exceed 10gbps, but to be honest I do not know how FRR will perform
without any optimized data-plane in this setup.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Any experience?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Cheers,<u></u><u></u></p>
<p class="MsoNormal">Heri<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div style="border-right:none currentcolor;border-bottom:none currentcolor;border-left:none currentcolor;border-top:1pt solid currentcolor;padding:3pt 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">Von:
</span></b><span style="font-size:12pt;color:black">Donald Sharp <<a href="mailto:sharpd@cumulusnetworks.com" target="_blank">sharpd@cumulusnetworks.com</a>><br>
<b>Datum: </b>Donnerstag, 21. Februar 2019 um 13:23<br>
<b>An: </b>Steuer Heribert <<a href="mailto:steuer@patronas.com" target="_blank">steuer@patronas.com</a>><br>
<b>Cc: </b>"<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>" <<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a>><br>
<b>Betreff: </b>Re: [FROG] Hardware Requirements</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Steuer -
<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">This is not something that we've put together at this point in time. FRR works quite nicely on all modern processors but you seem more concerned about data plane forwarding, which
while understandable, is not something we have a bunch of control over. As I understand it using something like XDP or DPDK works quite nicely as accelerators for packet processing, it is just not something I have experience with.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">donald<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">On Thu, Feb 21, 2019 at 7:20 AM Steuer Heribert <<a href="mailto:steuer@patronas.com" target="_blank">steuer@patronas.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none currentcolor;border-right:none currentcolor;border-bottom:none currentcolor;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)">Hello,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)">for using FRR with VPP & underlying DPDK, is there any “working hardware” list which goes beyond “use Intel NICs”? I
am aware of some white box lists provided by NOS vendors but was not able to find anything about native FRR. I´ve found some posts of
<a href="http://cloudscale.ch" target="_blank">cloudscale.ch</a> where they mentioned appliances from a vendor named Lanner (which I never heard of before). Its not about advertising vendors but more kind of a “known-to-work-well” list.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)">In addition it would be nice to chat on Slack, please invite
</span><span style="font-family:"Apple Color Emoji";color:rgb(0,55,158)">😊</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)">Thanks,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Tahoma,sans-serif;color:rgb(0,55,158)">Heri</span><u></u><u></u></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" target="_blank">https://lists.frrouting.org/listinfo/frog</a><u></u><u></u></p>
</blockquote>
</div>
</div>
</div>
</blockquote>
<blockquote style="margin-top:5pt;margin-bottom:5pt">
<div>
<p class="MsoNormal">_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" target="_blank">https://lists.frrouting.org/listinfo/frog</a><u></u><u></u></p>
</div>
</blockquote>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" target="_blank">https://lists.frrouting.org/listinfo/frog</a><u></u><u></u></p>
</blockquote>
</div>
</div>
</div>
_______________________________________________<br>
frog mailing list<br>
<a href="mailto:frog@lists.frrouting.org" target="_blank">frog@lists.frrouting.org</a><br>
<a href="https://lists.frrouting.org/listinfo/frog" rel="noreferrer" target="_blank">https://lists.frrouting.org/listinfo/frog</a><br>
</blockquote></div>