Problems regarding BGP code 2, sub-code 7 when peering with Cisco IOS-XR Version 4.2.3 over IPv6
FRRouting-Dev <dev@lists.frrouting.org> Hit an interesting issue today. (for reference a lot of technical details below) I found myself unable to locate the option of turning BGP code 2, sub-code 7 off when sending capabilities to a neighbor. (Spent some time googling around but mostly found Cisco IOS-XR related stuff) It appears Cisco IOS-XR does not yet support the use off 'additional-paths' (BGP code 2, sub-code 7) when exchanging neighbor capabilities. But ONLY for IPv6 (IPv4 is supported). So my question to the list (if anyone finds the time to answer) is: Does FFRouting contain an option to turn off the multi-path feature / specific sub-code when announcing BGPv4 capabilities to it's neighbor(s) over IPv6 (or both IPv4/v6) ? Nb: And yes. Have tried disabling sending capabilities to the IOS-XR router altogether. But the the Cisco router just refuses because no capabilities is announced from neighbor. Nb(2): Capability option is set to 'Dynamic' when announcing to neighbor. -- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd Software Details ================ pfSense v2.3.4 -------------- * Name: frr * Category: net * Version: 0.0.2 * Description: FRR routing daemon for BGP, OSPF, and OSPF6 Conflicts with Quagga OSPF and OpenBGPD. These packages cannot be installed at the same time. Debug output from Cisco IOS XR Software, Version 4.2.3[Default] =============================================================== * NOTE(1): IPv6 network prefix replaced with '2001:db8::' RP/0/RSP0/CPU0:Sep 26 16:49:36.532 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Idle to Connect RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Received message from 2001:db8:::250:56ff:febd:7e57 with type 1, length (incl. header) 102 RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Receive message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0066 0104 ff4c 0078 5774 0604 4902 0601 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 0100 0102 0280 0002 0202 0002 0641 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 00ff 4c02 0645 0400 0101 0102 0242 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0002 0243 0002 1949 1715 6677 3031 2e6c RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 6162 2e6e 6574 7261 766e 656e 2e65 7500 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0204 4002 8078 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: Received OPEN from 2001:db8:::250:56ff:febd:7e57, version 4, holdtime 120 secs RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has MULTIPROTOCOL_EXTENSION capability for afi/safi: 1/1 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability(old) for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has 4-byte AS capability with AS 65356 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 Addr-family 1/1 not supported: Ignoring the ADDPATH capability RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 66, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 67, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 25 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 73, length 23 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 4 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: bgp_io_read_schedule_updgrp: NO updgrp scheduled after Open processing: nbr=2001:db8:::250:56ff:febd:7e57, nbrfl=0x08314080 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Connect to OpenSent RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending OPEN to 2001:db8:::250:56ff:febd:7e57, version 4, my as: 31027, holdtime 120 seconds RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has capabilities with no supported address-family. RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending NOTIFICATION 2/7 (unsupported/disjoint capability) to 2001:db8:::250:56ff:febd:7e57 (0 bytes: ) RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from OpenSent to Closing RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 send message type 3, length (incl. header) 21 RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: Send message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 0015 0302 07 RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Closing to Idle RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 reset due to BGP Notification sent Output from pfSense FRR routing daemon ====================================== * NOTE(1): IPv6 network prefix replaced with '2001:db8::' * NOTE(2): IPv4 next-hop replaced with TEST-NET-3 address 203.0.113.4 BGP neighbor is 2001:db8::1, remote AS #ISP-ASN#, local AS 65356, external link BGP version 4, remote router ID 0.0.0.0 BGP state = Idle Last read 00:00:27, Last write 00:00:11 Hold time is 120, keepalive interval is 40 seconds Message statistics: Inq depth is 0 Outq depth is 0 Sent Rcvd Opens: 4 0 Notifications: 0 4 Updates: 0 0 Keepalives: 0 0 Route Refresh: 0 0 Capability: 0 0 Total: 4 4 Minimum time between advertisement runs is 0 seconds Update source is 2001:db8::250:56ff:febd:7e57 For address family: IPv4 Unicast Not part of any update group Community attribute sent to this neighbor(extended) 0 accepted prefixes Connections established 0; dropped 0 Last reset 00:00:27, due to NOTIFICATION received (OPEN Message Error/Unsupported Capability) Local host: 2001:db8::250:56ff:febd:7e57, Local port: 57277 Foreign host: 2001:db8::1, Foreign port: 179 Nexthop: 203.0.113.4 Nexthop global: 2001:db8::250:56ff:febd:7e57 Nexthop local: fe80::250:56ff:febd:7e57 BGP connection: shared network BGP Connect Retry Timer in Seconds: 120 Next start timer due in 5 seconds Read thread: off Write thread: off
Hi Christoffer, FRR will always advertise the capability for "RX addpath" but we will only advertise "TX addpath" if you configure one of the "neighbor x.x.x.x addpath...." knobs. In your case it sounds like XR is getting confused about us sending the "RX addpath" capability on a v6 session. That shouldn't cause it to send a NOTIFICATION though so I am wondering if maybe we are formatting something incorrectly in the OPEN. Any chance you can get a .pcap of the session that is bouncing? thx Daniel On Tue, Sep 26, 2017 at 12:06 PM, Christoffer Hansen <netravnen@gmail.com> wrote:
FRRouting-Dev <dev@lists.frrouting.org>
Hit an interesting issue today. (for reference a lot of technical details below)
I found myself unable to locate the option of turning BGP code 2, sub-code 7 off when sending capabilities to a neighbor. (Spent some time googling around but mostly found Cisco IOS-XR related stuff)
It appears Cisco IOS-XR does not yet support the use off 'additional-paths' (BGP code 2, sub-code 7) when exchanging neighbor capabilities. But ONLY for IPv6 (IPv4 is supported).
So my question to the list (if anyone finds the time to answer) is: Does FFRouting contain an option to turn off the multi-path feature / specific sub-code when announcing BGPv4 capabilities to it's neighbor(s) over IPv6 (or both IPv4/v6) ?
Nb: And yes. Have tried disabling sending capabilities to the IOS-XR router altogether. But the the Cisco router just refuses because no capabilities is announced from neighbor.
Nb(2): Capability option is set to 'Dynamic' when announcing to neighbor.
-- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd
Software Details ================
pfSense v2.3.4 -------------- * Name: frr * Category: net * Version: 0.0.2 * Description: FRR routing daemon for BGP, OSPF, and OSPF6 Conflicts with Quagga OSPF and OpenBGPD. These packages cannot be installed at the same time.
Debug output from Cisco IOS XR Software, Version 4.2.3[Default] ===============================================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::'
RP/0/RSP0/CPU0:Sep 26 16:49:36.532 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Idle to Connect RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Received message from 2001:db8:::250:56ff:febd:7e57 with type 1, length (incl. header) 102 RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Receive message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0066 0104 ff4c 0078 5774 0604 4902 0601 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 0100 0102 0280 0002 0202 0002 0641 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 00ff 4c02 0645 0400 0101 0102 0242 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0002 0243 0002 1949 1715 6677 3031 2e6c RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 6162 2e6e 6574 7261 766e 656e 2e65 7500 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0204 4002 8078 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: Received OPEN from 2001:db8:::250:56ff:febd:7e57, version 4, holdtime 120 secs RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has MULTIPROTOCOL_EXTENSION capability for afi/safi: 1/1 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability(old) for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has 4-byte AS capability with AS 65356 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 Addr-family 1/1 not supported: Ignoring the ADDPATH capability RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 66, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 67, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 25 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 73, length 23 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 4 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: bgp_io_read_schedule_updgrp: NO updgrp scheduled after Open processing: nbr=2001:db8:::250:56ff:febd:7e57, nbrfl=0x08314080 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Connect to OpenSent RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending OPEN to 2001:db8:::250:56ff:febd:7e57, version 4, my as: 31027, holdtime 120 seconds RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has capabilities with no supported address-family. RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending NOTIFICATION 2/7 (unsupported/disjoint capability) to 2001:db8:::250:56ff:febd:7e57 (0 bytes: ) RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from OpenSent to Closing RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 send message type 3, length (incl. header) 21 RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: Send message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 0015 0302 07 RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Closing to Idle RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 reset due to BGP Notification sent
Output from pfSense FRR routing daemon ======================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::' * NOTE(2): IPv4 next-hop replaced with TEST-NET-3 address 203.0.113.4
BGP neighbor is 2001:db8::1, remote AS #ISP-ASN#, local AS 65356, external link BGP version 4, remote router ID 0.0.0.0 BGP state = Idle Last read 00:00:27, Last write 00:00:11 Hold time is 120, keepalive interval is 40 seconds Message statistics: Inq depth is 0 Outq depth is 0 Sent Rcvd Opens: 4 0 Notifications: 0 4 Updates: 0 0 Keepalives: 0 0 Route Refresh: 0 0 Capability: 0 0 Total: 4 4 Minimum time between advertisement runs is 0 seconds Update source is 2001:db8::250:56ff:febd:7e57
For address family: IPv4 Unicast Not part of any update group Community attribute sent to this neighbor(extended) 0 accepted prefixes
Connections established 0; dropped 0 Last reset 00:00:27, due to NOTIFICATION received (OPEN Message Error/Unsupported Capability) Local host: 2001:db8::250:56ff:febd:7e57, Local port: 57277 Foreign host: 2001:db8::1, Foreign port: 179 Nexthop: 203.0.113.4 Nexthop global: 2001:db8::250:56ff:febd:7e57 Nexthop local: fe80::250:56ff:febd:7e57 BGP connection: shared network BGP Connect Retry Timer in Seconds: 120 Next start timer due in 5 seconds Read thread: off Write thread: off
_______________________________________________ dev mailing list dev@lists.frrouting.org https://lists.frrouting.org/listinfo/dev
Any chance you can get a .pcap of the session that is bouncing?
Refer to attached file. "my-packetcapture.cap" ---- Had the dreary experiencing today (again) when trying to setup a HE (full feed) BGP tunnel between the pfSense FRR daemon and HE Frankfurt BGP endpoint. Refer to attached file. "henetv6-bgp-tunnel-packetcapture.cap" ---- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd On 9/26/2017 20:19, Daniel Walton wrote:
Hi Christoffer, FRR will always advertise the capability for "RX addpath" but we will only advertise "TX addpath" if you configure one of the "neighbor x.x.x.x addpath...." knobs. In your case it sounds like XR is getting confused about us sending the "RX addpath" capability on a v6 session. That shouldn't cause it to send a NOTIFICATION though so I am wondering if maybe we are formatting something incorrectly in the OPEN. Any chance you can get a .pcap of the session that is bouncing?
thx Daniel
On Tue, Sep 26, 2017 at 12:06 PM, Christoffer Hansen <netravnen@gmail.com <mailto:netravnen@gmail.com>> wrote:
FRRouting-Dev <dev@lists.frrouting.org <mailto:dev@lists.frrouting.org>>
Hit an interesting issue today. (for reference a lot of technical details below)
I found myself unable to locate the option of turning BGP code 2, sub-code 7 off when sending capabilities to a neighbor. (Spent some time googling around but mostly found Cisco IOS-XR related stuff)
It appears Cisco IOS-XR does not yet support the use off 'additional-paths' (BGP code 2, sub-code 7) when exchanging neighbor capabilities. But ONLY for IPv6 (IPv4 is supported).
So my question to the list (if anyone finds the time to answer) is: Does FFRouting contain an option to turn off the multi-path feature / specific sub-code when announcing BGPv4 capabilities to it's neighbor(s) over IPv6 (or both IPv4/v6) ?
Nb: And yes. Have tried disabling sending capabilities to the IOS-XR router altogether. But the the Cisco router just refuses because no capabilities is announced from neighbor.
Nb(2): Capability option is set to 'Dynamic' when announcing to neighbor.
-- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd
Software Details ================
pfSense v2.3.4 -------------- * Name: frr * Category: net * Version: 0.0.2 * Description: FRR routing daemon for BGP, OSPF, and OSPF6 Conflicts with Quagga OSPF and OpenBGPD. These packages cannot be installed at the same time.
Debug output from Cisco IOS XR Software, Version 4.2.3[Default] ===============================================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::'
RP/0/RSP0/CPU0:Sep 26 16:49:36.532 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Idle to Connect RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Received message from 2001:db8:::250:56ff:febd:7e57 with type 1, length (incl. header) 102 RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Receive message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0066 0104 ff4c 0078 5774 0604 4902 0601 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 0100 0102 0280 0002 0202 0002 0641 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 00ff 4c02 0645 0400 0101 0102 0242 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0002 0243 0002 1949 1715 6677 3031 2e6c RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 6162 2e6e 6574 7261 766e 656e 2e65 7500 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0204 4002 8078 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: Received OPEN from 2001:db8:::250:56ff:febd:7e57, version 4, holdtime 120 secs RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has MULTIPROTOCOL_EXTENSION capability for afi/safi: 1/1 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability(old) for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has 4-byte AS capability with AS 65356 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 Addr-family 1/1 not supported: Ignoring the ADDPATH capability RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 66, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 67, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 25 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 73, length 23 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 4 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: bgp_io_read_schedule_updgrp: NO updgrp scheduled after Open processing: nbr=2001:db8:::250:56ff:febd:7e57, nbrfl=0x08314080 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Connect to OpenSent RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending OPEN to 2001:db8:::250:56ff:febd:7e57, version 4, my as: 31027, holdtime 120 seconds RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has capabilities with no supported address-family. RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending NOTIFICATION 2/7 (unsupported/disjoint capability) to 2001:db8:::250:56ff:febd:7e57 (0 bytes: ) RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from OpenSent to Closing RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 send message type 3, length (incl. header) 21 RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: Send message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 0015 0302 07 RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Closing to Idle RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 reset due to BGP Notification sent
Output from pfSense FRR routing daemon ======================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::' * NOTE(2): IPv4 next-hop replaced with TEST-NET-3 address 203.0.113.4
BGP neighbor is 2001:db8::1, remote AS #ISP-ASN#, local AS 65356, external link BGP version 4, remote router ID 0.0.0.0 BGP state = Idle Last read 00:00:27, Last write 00:00:11 Hold time is 120, keepalive interval is 40 seconds Message statistics: Inq depth is 0 Outq depth is 0 Sent Rcvd Opens: 4 0 Notifications: 0 4 Updates: 0 0 Keepalives: 0 0 Route Refresh: 0 0 Capability: 0 0 Total: 4 4 Minimum time between advertisement runs is 0 seconds Update source is 2001:db8::250:56ff:febd:7e57
For address family: IPv4 Unicast Not part of any update group Community attribute sent to this neighbor(extended) 0 accepted prefixes
Connections established 0; dropped 0 Last reset 00:00:27, due to NOTIFICATION received (OPEN Message Error/Unsupported Capability) Local host: 2001:db8::250:56ff:febd:7e57, Local port: 57277 Foreign host: 2001:db8::1, Foreign port: 179 Nexthop: 203.0.113.4 Nexthop global: 2001:db8::250:56ff:febd:7e57 Nexthop local: fe80::250:56ff:febd:7e57 BGP connection: shared network BGP Connect Retry Timer in Seconds: 120 Next start timer due in 5 seconds Read thread: off Write thread: off
_______________________________________________ dev mailing list dev@lists.frrouting.org <mailto:dev@lists.frrouting.org> https://lists.frrouting.org/listinfo/dev <https://lists.frrouting.org/listinfo/dev>
But yes. All the fuzz is the fault of the Cisco IOS-XR platform not supporting the add-path capability for eBGP peerings :/
Add path is not be supported with MDT, tunnel, and L2VPN address families and eBGP peerings. https://www.cisco.com/c/en/us/td/docs/routers/crs/software/crs_r4-2/routing/...
Cisco has only implemented iBGP support for the add-path functionality (do not know if they have done something different in IOS-XR 6.x releases) Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd -------- Forwarded Message -------- Subject: Re: [dev] Problems regarding BGP code 2, sub-code 7 when peering with Cisco IOS-XR Version 4.2.3 over IPv6 Date: Tue, 17 Oct 2017 14:48:40 +0200 From: Christoffer Hansen <netravnen@gmail.com> To: Daniel Walton <dwalton@cumulusnetworks.com> CC: FRRouting-Dev <dev@lists.frrouting.org>
Any chance you can get a .pcap of the session that is bouncing?
Refer to attached file. "my-packetcapture.cap" ---- Had the dreary experiencing today (again) when trying to setup a HE (full feed) BGP tunnel between the pfSense FRR daemon and HE Frankfurt BGP endpoint. Refer to attached file. "henetv6-bgp-tunnel-packetcapture.cap" ---- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd On 9/26/2017 20:19, Daniel Walton wrote:
Hi Christoffer, FRR will always advertise the capability for "RX addpath" but we will only advertise "TX addpath" if you configure one of the "neighbor x.x.x.x addpath...." knobs. In your case it sounds like XR is getting confused about us sending the "RX addpath" capability on a v6 session. That shouldn't cause it to send a NOTIFICATION though so I am wondering if maybe we are formatting something incorrectly in the OPEN. Any chance you can get a .pcap of the session that is bouncing?
thx Daniel
On Tue, Sep 26, 2017 at 12:06 PM, Christoffer Hansen <netravnen@gmail.com <mailto:netravnen@gmail.com>> wrote:
FRRouting-Dev <dev@lists.frrouting.org <mailto:dev@lists.frrouting.org>>
Hit an interesting issue today. (for reference a lot of technical details below)
I found myself unable to locate the option of turning BGP code 2, sub-code 7 off when sending capabilities to a neighbor. (Spent some time googling around but mostly found Cisco IOS-XR related stuff)
It appears Cisco IOS-XR does not yet support the use off 'additional-paths' (BGP code 2, sub-code 7) when exchanging neighbor capabilities. But ONLY for IPv6 (IPv4 is supported).
So my question to the list (if anyone finds the time to answer) is: Does FFRouting contain an option to turn off the multi-path feature / specific sub-code when announcing BGPv4 capabilities to it's neighbor(s) over IPv6 (or both IPv4/v6) ?
Nb: And yes. Have tried disabling sending capabilities to the IOS-XR router altogether. But the the Cisco router just refuses because no capabilities is announced from neighbor.
Nb(2): Capability option is set to 'Dynamic' when announcing to neighbor.
-- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd
Software Details ================
pfSense v2.3.4 -------------- * Name: frr * Category: net * Version: 0.0.2 * Description: FRR routing daemon for BGP, OSPF, and OSPF6 Conflicts with Quagga OSPF and OpenBGPD. These packages cannot be installed at the same time.
Debug output from Cisco IOS XR Software, Version 4.2.3[Default] ===============================================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::'
RP/0/RSP0/CPU0:Sep 26 16:49:36.532 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Idle to Connect RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Received message from 2001:db8:::250:56ff:febd:7e57 with type 1, length (incl. header) 102 RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Receive message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0066 0104 ff4c 0078 5774 0604 4902 0601 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 0100 0102 0280 0002 0202 0002 0641 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 00ff 4c02 0645 0400 0101 0102 0242 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0002 0243 0002 1949 1715 6677 3031 2e6c RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 6162 2e6e 6574 7261 766e 656e 2e65 7500 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0204 4002 8078 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: Received OPEN from 2001:db8:::250:56ff:febd:7e57, version 4, holdtime 120 secs RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has MULTIPROTOCOL_EXTENSION capability for afi/safi: 1/1 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability(old) for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has 4-byte AS capability with AS 65356 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 Addr-family 1/1 not supported: Ignoring the ADDPATH capability RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 66, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 67, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 25 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 73, length 23 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 4 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: bgp_io_read_schedule_updgrp: NO updgrp scheduled after Open processing: nbr=2001:db8:::250:56ff:febd:7e57, nbrfl=0x08314080 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Connect to OpenSent RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending OPEN to 2001:db8:::250:56ff:febd:7e57, version 4, my as: 31027, holdtime 120 seconds RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has capabilities with no supported address-family. RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending NOTIFICATION 2/7 (unsupported/disjoint capability) to 2001:db8:::250:56ff:febd:7e57 (0 bytes: ) RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from OpenSent to Closing RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 send message type 3, length (incl. header) 21 RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: Send message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 0015 0302 07 RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Closing to Idle RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 reset due to BGP Notification sent
Output from pfSense FRR routing daemon ======================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::' * NOTE(2): IPv4 next-hop replaced with TEST-NET-3 address 203.0.113.4
BGP neighbor is 2001:db8::1, remote AS #ISP-ASN#, local AS 65356, external link BGP version 4, remote router ID 0.0.0.0 BGP state = Idle Last read 00:00:27, Last write 00:00:11 Hold time is 120, keepalive interval is 40 seconds Message statistics: Inq depth is 0 Outq depth is 0 Sent Rcvd Opens: 4 0 Notifications: 0 4 Updates: 0 0 Keepalives: 0 0 Route Refresh: 0 0 Capability: 0 0 Total: 4 4 Minimum time between advertisement runs is 0 seconds Update source is 2001:db8::250:56ff:febd:7e57
For address family: IPv4 Unicast Not part of any update group Community attribute sent to this neighbor(extended) 0 accepted prefixes
Connections established 0; dropped 0 Last reset 00:00:27, due to NOTIFICATION received (OPEN Message Error/Unsupported Capability) Local host: 2001:db8::250:56ff:febd:7e57, Local port: 57277 Foreign host: 2001:db8::1, Foreign port: 179 Nexthop: 203.0.113.4 Nexthop global: 2001:db8::250:56ff:febd:7e57 Nexthop local: fe80::250:56ff:febd:7e57 BGP connection: shared network BGP Connect Retry Timer in Seconds: 120 Next start timer due in 5 seconds Read thread: off Write thread: off
_______________________________________________ dev mailing list dev@lists.frrouting.org <mailto:dev@lists.frrouting.org> https://lists.frrouting.org/listinfo/dev <https://lists.frrouting.org/listinfo/dev>
Dear Daniel Walton Is the following intended behavior for FRR ? 1. Type: Multiprotocol extensions capability (1) Length: 4 AFI: IPv4 (1) Reserved: 00 SAFI: Unicast (1) 2. Type: Support for Additional Paths (69) Length: 4 AFI: IPv4 (1) SAFI: Unicast (1) Send/Receive: Receive (1) Advertising MP and add-paths 'AFI: IPv4 (1)' instead of 'AFI: IPv6 (2)' Even through the neighbor-ship is meant to be formed purely over IPv6 ? Reply from Kelly Cochran <ipv6@he.net> on a ticket i have with HENET concerning the ipv6 bgp peering I'm trying to setup with AS6939. ============================================================================
Unsupported notifications are supposed to send the capability sent which wasn't able to be handled, which in this case is your side sending 01 (type: MP extensions) 04 (length: 4 bytes) 00 02 00 01 (value: AFI: IPv6, SAFI: unicast). This reads like your side doesn't want to do IPv6 unicast BGP routes
Logs ============================================================================= Oct 19 14:22:52 bgpd 39957 %NOTIFICATION: sent to neighbor 2a02:188:2:d6::1 2/7 (OPEN Message Error/Unsupported Capability) 6 bytes 01 04 00 02 00 01 Oct 19 14:22:52 bgpd 39957 2a02:188:2:d6::1 [Error] Configured AFI/SAFIs do not overlap with received MP capabilities Oct 19 14:22:19 bgpd 39957 %NOTIFICATION: sent to neighbor 2a02:188:2:d6::1 2/7 (OPEN Message Error/Unsupported Capability) 6 bytes 01 04 00 02 00 01 Oct 19 14:22:19 bgpd 39957 2a02:188:2:d6::1 [Error] Configured AFI/SAFIs do not overlap with received MP capabilities Oct 19 14:21:54 bgpd 39957 %NOTIFICATION: received from neighbor 2a02:188:2:d6::1 2/7 (OPEN Message Error/Unsupported Capability) 0 bytes Oct 19 14:21:52 bgpd 39957 %NOTIFICATION: sent to neighbor 2001:470:12:4d::1 2/7 (OPEN Message Error/Unsupported Capability) 6 bytes 01 04 00 02 00 01 Oct 19 14:21:52 bgpd 39957 2001:470:12:4d::1 [Error] Configured AFI/SAFIs do not overlap with received MP capabilities Copy of decoded package from packet capture ============================================================================= Frame 1291: 159 bytes on wire (1272 bits), 159 bytes captured (1272 bits) Encapsulation type: NULL/Loopback (15) Arrival Time: Oct 19, 2017 14:04:16.118700000 Rom, sommertid [Time shift for this packet: 0.000000000 seconds] Epoch Time: 1508414656.118700000 seconds [Time delta from previous captured frame: 0.000111000 seconds] [Time delta from previous displayed frame: 120.070000000 seconds] [Time since reference or first frame: 967.073591000 seconds] Frame Number: 1291 Frame Length: 159 bytes (1272 bits) Capture Length: 159 bytes (1272 bits) [Frame is marked: False] [Frame is ignored: False] [Protocols in frame: null:ipv6:tcp:bgp] [Coloring Rule Name: Routing] [Coloring Rule String: hsrp || eigrp || ospf || bgp || cdp || vrrp || carp || gvrp || igmp || ismp] Null/Loopback Family: IPv6 (28) Internet Protocol Version 6, Src: 2001:470:12:4d::2, Dst: 2001:470:12:4d::1 0110 .... = Version: 6 .... 1100 0000 .... .... .... .... .... = Traffic Class: 0xc0 (DSCP: CS6, ECN: Not-ECT) .... 1100 00.. .... .... .... .... .... = Differentiated Services Codepoint: Class Selector 6 (48) .... .... ..00 .... .... .... .... .... = Explicit Congestion Notification: Not ECN-Capable Transport (0) .... .... .... 0111 1011 0010 0011 0010 = Flow Label: 0x7b232 Payload Length: 115 Next Header: TCP (6) Hop Limit: 1 Source: 2001:470:12:4d::2 Destination: 2001:470:12:4d::1 [Source GeoIP: Unknown] [Destination GeoIP: Unknown] Transmission Control Protocol, Src Port: 46632, Dst Port: 179, Seq: 1, Ack: 1, Len: 95 Source Port: 46632 Destination Port: 179 [Stream index: 62] [TCP Segment Len: 95] Sequence number: 1 (relative sequence number) [Next sequence number: 96 (relative sequence number)] Acknowledgment number: 1 (relative ack number) 0101 .... = Header Length: 20 bytes (5) Flags: 0x018 (PSH, ACK) 000. .... .... = Reserved: Not set ...0 .... .... = Nonce: Not set .... 0... .... = Congestion Window Reduced (CWR): Not set .... .0.. .... = ECN-Echo: Not set .... ..0. .... = Urgent: Not set .... ...1 .... = Acknowledgment: Set .... .... 1... = Push: Set .... .... .0.. = Reset: Not set .... .... ..0. = Syn: Not set .... .... ...0 = Fin: Not set [TCP Flags: ·······AP···] Window size value: 65535 [Calculated window size: 65535] [Window size scaling factor: -2 (no window scaling used)] Checksum: 0x7d60 [unverified] [Checksum Status: Unverified] Urgent pointer: 0 [SEQ/ACK analysis] [iRTT: 0.018972000 seconds] [Bytes in flight: 95] [Bytes sent since last PSH flag: 95] TCP payload (95 bytes) Border Gateway Protocol - OPEN Message Marker: ffffffffffffffffffffffffffffffff Length: 95 Type: OPEN Message (1) Version: 4 My AS: 34932 Hold Time: 180 BGP Identifier: 87.116.6.4 Optional Parameters Length: 66 Optional Parameters Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 6 Capability: Multiprotocol extensions capability Type: Multiprotocol extensions capability (1) Length: 4 AFI: IPv4 (1) Reserved: 00 SAFI: Unicast (1) Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 2 Capability: Route refresh capability (Cisco) Type: Route refresh capability (Cisco) (128) Length: 0 Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 2 Capability: Route refresh capability Type: Route refresh capability (2) Length: 0 Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 6 Capability: Support for 4-octet AS number capability Type: Support for 4-octet AS number capability (65) Length: 4 AS Number: 34932 Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 6 Capability: Support for Additional Paths Type: Support for Additional Paths (69) Length: 4 AFI: IPv4 (1) SAFI: Unicast (1) Send/Receive: Receive (1) Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 26 Capability: FQDN Capability Type: FQDN Capability (73) Length: 24 Hostname Length: 22 Hostname: fw01.lab.netravnen.org Domain Name Length: 0 Domain Name: Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 4 Capability: Graceful Restart capability Type: Graceful Restart capability (64) Length: 2 [Expert Info (Chat/Request): Graceful Restart Capability supported in Helper mode only] [Graceful Restart Capability supported in Helper mode only] [Severity level: Chat] [Group: Request] Restart Timers: 0x0078 0... .... .... .... = Restart: No .... 0000 0111 1000 = Time: 120 Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd -------- Forwarded Message -------- Subject: Fwd: [dev] Problems regarding BGP code 2, sub-code 7 when peering with Cisco IOS-XR Version 4.2.3 over IPv6 Date: Thu, 19 Oct 2017 12:34:05 +0200 From: Christoffer Hansen <netravnen@gmail.com> To: Daniel Walton <dwalton@cumulusnetworks.com> CC: FRRouting-Dev <dev@lists.frrouting.org> But yes. All the fuzz is the fault of the Cisco IOS-XR platform not supporting the add-path capability for eBGP peerings :/
Add path is not be supported with MDT, tunnel, and L2VPN address families and eBGP peerings. https://www.cisco.com/c/en/us/td/docs/routers/crs/software/crs_r4-2/routing/...
Cisco has only implemented iBGP support for the add-path functionality (do not know if they have done something different in IOS-XR 6.x releases) Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd -------- Forwarded Message -------- Subject: Re: [dev] Problems regarding BGP code 2, sub-code 7 when peering with Cisco IOS-XR Version 4.2.3 over IPv6 Date: Tue, 17 Oct 2017 14:48:40 +0200 From: Christoffer Hansen <netravnen@gmail.com> To: Daniel Walton <dwalton@cumulusnetworks.com> CC: FRRouting-Dev <dev@lists.frrouting.org>
Any chance you can get a .pcap of the session that is bouncing?
Refer to attached file. "my-packetcapture.cap" ---- Had the dreary experiencing today (again) when trying to setup a HE (full feed) BGP tunnel between the pfSense FRR daemon and HE Frankfurt BGP endpoint. Refer to attached file. "henetv6-bgp-tunnel-packetcapture.cap" ---- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd On 9/26/2017 20:19, Daniel Walton wrote:
Hi Christoffer, FRR will always advertise the capability for "RX addpath" but we will only advertise "TX addpath" if you configure one of the "neighbor x.x.x.x addpath...." knobs. In your case it sounds like XR is getting confused about us sending the "RX addpath" capability on a v6 session. That shouldn't cause it to send a NOTIFICATION though so I am wondering if maybe we are formatting something incorrectly in the OPEN. Any chance you can get a .pcap of the session that is bouncing?
thx Daniel
On Tue, Sep 26, 2017 at 12:06 PM, Christoffer Hansen <netravnen@gmail.com <mailto:netravnen@gmail.com>> wrote:
FRRouting-Dev <dev@lists.frrouting.org <mailto:dev@lists.frrouting.org>>
Hit an interesting issue today. (for reference a lot of technical details below)
I found myself unable to locate the option of turning BGP code 2, sub-code 7 off when sending capabilities to a neighbor. (Spent some time googling around but mostly found Cisco IOS-XR related stuff)
It appears Cisco IOS-XR does not yet support the use off 'additional-paths' (BGP code 2, sub-code 7) when exchanging neighbor capabilities. But ONLY for IPv6 (IPv4 is supported).
So my question to the list (if anyone finds the time to answer) is: Does FFRouting contain an option to turn off the multi-path feature / specific sub-code when announcing BGPv4 capabilities to it's neighbor(s) over IPv6 (or both IPv4/v6) ?
Nb: And yes. Have tried disabling sending capabilities to the IOS-XR router altogether. But the the Cisco router just refuses because no capabilities is announced from neighbor.
Nb(2): Capability option is set to 'Dynamic' when announcing to neighbor.
-- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd
Software Details ================
pfSense v2.3.4 -------------- * Name: frr * Category: net * Version: 0.0.2 * Description: FRR routing daemon for BGP, OSPF, and OSPF6 Conflicts with Quagga OSPF and OpenBGPD. These packages cannot be installed at the same time.
Debug output from Cisco IOS XR Software, Version 4.2.3[Default] ===============================================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::'
RP/0/RSP0/CPU0:Sep 26 16:49:36.532 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Idle to Connect RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Received message from 2001:db8:::250:56ff:febd:7e57 with type 1, length (incl. header) 102 RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Receive message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0066 0104 ff4c 0078 5774 0604 4902 0601 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 0100 0102 0280 0002 0202 0002 0641 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 00ff 4c02 0645 0400 0101 0102 0242 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0002 0243 0002 1949 1715 6677 3031 2e6c RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 6162 2e6e 6574 7261 766e 656e 2e65 7500 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0204 4002 8078 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: Received OPEN from 2001:db8:::250:56ff:febd:7e57, version 4, holdtime 120 secs RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has MULTIPROTOCOL_EXTENSION capability for afi/safi: 1/1 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability(old) for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has 4-byte AS capability with AS 65356 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 Addr-family 1/1 not supported: Ignoring the ADDPATH capability RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 66, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 67, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 25 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 73, length 23 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 4 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: bgp_io_read_schedule_updgrp: NO updgrp scheduled after Open processing: nbr=2001:db8:::250:56ff:febd:7e57, nbrfl=0x08314080 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Connect to OpenSent RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending OPEN to 2001:db8:::250:56ff:febd:7e57, version 4, my as: 31027, holdtime 120 seconds RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has capabilities with no supported address-family. RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending NOTIFICATION 2/7 (unsupported/disjoint capability) to 2001:db8:::250:56ff:febd:7e57 (0 bytes: ) RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from OpenSent to Closing RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 send message type 3, length (incl. header) 21 RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: Send message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 0015 0302 07 RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Closing to Idle RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 reset due to BGP Notification sent
Output from pfSense FRR routing daemon ======================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::' * NOTE(2): IPv4 next-hop replaced with TEST-NET-3 address 203.0.113.4
BGP neighbor is 2001:db8::1, remote AS #ISP-ASN#, local AS 65356, external link BGP version 4, remote router ID 0.0.0.0 BGP state = Idle Last read 00:00:27, Last write 00:00:11 Hold time is 120, keepalive interval is 40 seconds Message statistics: Inq depth is 0 Outq depth is 0 Sent Rcvd Opens: 4 0 Notifications: 0 4 Updates: 0 0 Keepalives: 0 0 Route Refresh: 0 0 Capability: 0 0 Total: 4 4 Minimum time between advertisement runs is 0 seconds Update source is 2001:db8::250:56ff:febd:7e57
For address family: IPv4 Unicast Not part of any update group Community attribute sent to this neighbor(extended) 0 accepted prefixes
Connections established 0; dropped 0 Last reset 00:00:27, due to NOTIFICATION received (OPEN Message Error/Unsupported Capability) Local host: 2001:db8::250:56ff:febd:7e57, Local port: 57277 Foreign host: 2001:db8::1, Foreign port: 179 Nexthop: 203.0.113.4 Nexthop global: 2001:db8::250:56ff:febd:7e57 Nexthop local: fe80::250:56ff:febd:7e57 BGP connection: shared network BGP Connect Retry Timer in Seconds: 120 Next start timer due in 5 seconds Read thread: off Write thread: off
_______________________________________________ dev mailing list dev@lists.frrouting.org <mailto:dev@lists.frrouting.org> https://lists.frrouting.org/listinfo/dev <https://lists.frrouting.org/listinfo/dev>
On Thu, Oct 19, 2017 at 8:28 AM, Christoffer Hansen <netravnen@gmail.com> wrote:
Dear Daniel Walton
Is the following intended behavior for FRR ?
1. Type: Multiprotocol extensions capability (1) Length: 4 AFI: IPv4 (1) Reserved: 00 SAFI: Unicast (1)
2. Type: Support for Additional Paths (69) Length: 4 AFI: IPv4 (1) SAFI: Unicast (1) Send/Receive: Receive (1)
Advertising MP and add-paths 'AFI: IPv4 (1)' instead of 'AFI: IPv6 (2)'
Even through the neighbor-ship is meant to be formed purely over IPv6 ?
When the neighbor is formed over an IPv6 address we can still activate the IPv4 unicast address family (it is active by default in FRR unless you do 'no bgp default ipv4-unicast'). That is what is happening above, ipv4 unicast is 'active' for this neighbor so we advertise that capability which in turn causes us to advertise the ability to RX add-paths for that address-family. Daniel
Reply from Kelly Cochran <ipv6@he.net> on a ticket i have with HENET concerning the ipv6 bgp peering I'm trying to setup with AS6939. ============================================================ ================
Unsupported notifications are supposed to send the capability sent which wasn't able to be handled, which in this case is your side sending 01 (type: MP extensions) 04 (length: 4 bytes) 00 02 00 01 (value: AFI: IPv6, SAFI: unicast). This reads like your side doesn't want to do IPv6 unicast BGP routes
Logs ============================================================ ================= Oct 19 14:22:52 bgpd 39957 %NOTIFICATION: sent to neighbor 2a02:188:2:d6::1 2/7 (OPEN Message Error/Unsupported Capability) 6 bytes 01 04 00 02 00 01 Oct 19 14:22:52 bgpd 39957 2a02:188:2:d6::1 [Error] Configured AFI/SAFIs do not overlap with received MP capabilities Oct 19 14:22:19 bgpd 39957 %NOTIFICATION: sent to neighbor 2a02:188:2:d6::1 2/7 (OPEN Message Error/Unsupported Capability) 6 bytes 01 04 00 02 00 01 Oct 19 14:22:19 bgpd 39957 2a02:188:2:d6::1 [Error] Configured AFI/SAFIs do not overlap with received MP capabilities Oct 19 14:21:54 bgpd 39957 %NOTIFICATION: received from neighbor 2a02:188:2:d6::1 2/7 (OPEN Message Error/Unsupported Capability) 0 bytes Oct 19 14:21:52 bgpd 39957 %NOTIFICATION: sent to neighbor 2001:470:12:4d::1 2/7 (OPEN Message Error/Unsupported Capability) 6 bytes 01 04 00 02 00 01 Oct 19 14:21:52 bgpd 39957 2001:470:12:4d::1 [Error] Configured AFI/SAFIs do not overlap with received MP capabilities
Copy of decoded package from packet capture ============================================================ ================= Frame 1291: 159 bytes on wire (1272 bits), 159 bytes captured (1272 bits) Encapsulation type: NULL/Loopback (15) Arrival Time: Oct 19, 2017 14:04:16.118700000 Rom, sommertid [Time shift for this packet: 0.000000000 seconds] Epoch Time: 1508414656.118700000 seconds [Time delta from previous captured frame: 0.000111000 seconds] [Time delta from previous displayed frame: 120.070000000 seconds] [Time since reference or first frame: 967.073591000 seconds] Frame Number: 1291 Frame Length: 159 bytes (1272 bits) Capture Length: 159 bytes (1272 bits) [Frame is marked: False] [Frame is ignored: False] [Protocols in frame: null:ipv6:tcp:bgp] [Coloring Rule Name: Routing] [Coloring Rule String: hsrp || eigrp || ospf || bgp || cdp || vrrp || carp || gvrp || igmp || ismp] Null/Loopback Family: IPv6 (28) Internet Protocol Version 6, Src: 2001:470:12:4d::2, Dst: 2001:470:12:4d::1 0110 .... = Version: 6 .... 1100 0000 .... .... .... .... .... = Traffic Class: 0xc0 (DSCP: CS6, ECN: Not-ECT) .... 1100 00.. .... .... .... .... .... = Differentiated Services Codepoint: Class Selector 6 (48) .... .... ..00 .... .... .... .... .... = Explicit Congestion Notification: Not ECN-Capable Transport (0) .... .... .... 0111 1011 0010 0011 0010 = Flow Label: 0x7b232 Payload Length: 115 Next Header: TCP (6) Hop Limit: 1 Source: 2001:470:12:4d::2 Destination: 2001:470:12:4d::1 [Source GeoIP: Unknown] [Destination GeoIP: Unknown] Transmission Control Protocol, Src Port: 46632, Dst Port: 179, Seq: 1, Ack: 1, Len: 95 Source Port: 46632 Destination Port: 179 [Stream index: 62] [TCP Segment Len: 95] Sequence number: 1 (relative sequence number) [Next sequence number: 96 (relative sequence number)] Acknowledgment number: 1 (relative ack number) 0101 .... = Header Length: 20 bytes (5) Flags: 0x018 (PSH, ACK) 000. .... .... = Reserved: Not set ...0 .... .... = Nonce: Not set .... 0... .... = Congestion Window Reduced (CWR): Not set .... .0.. .... = ECN-Echo: Not set .... ..0. .... = Urgent: Not set .... ...1 .... = Acknowledgment: Set .... .... 1... = Push: Set .... .... .0.. = Reset: Not set .... .... ..0. = Syn: Not set .... .... ...0 = Fin: Not set [TCP Flags: ·······AP···] Window size value: 65535 [Calculated window size: 65535] [Window size scaling factor: -2 (no window scaling used)] Checksum: 0x7d60 [unverified] [Checksum Status: Unverified] Urgent pointer: 0 [SEQ/ACK analysis] [iRTT: 0.018972000 seconds] [Bytes in flight: 95] [Bytes sent since last PSH flag: 95] TCP payload (95 bytes) Border Gateway Protocol - OPEN Message Marker: ffffffffffffffffffffffffffffffff Length: 95 Type: OPEN Message (1) Version: 4 My AS: 34932 Hold Time: 180 BGP Identifier: 87.116.6.4 Optional Parameters Length: 66 Optional Parameters Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 6 Capability: Multiprotocol extensions capability Type: Multiprotocol extensions capability (1) Length: 4 AFI: IPv4 (1) Reserved: 00 SAFI: Unicast (1) Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 2 Capability: Route refresh capability (Cisco) Type: Route refresh capability (Cisco) (128) Length: 0 Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 2 Capability: Route refresh capability Type: Route refresh capability (2) Length: 0 Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 6 Capability: Support for 4-octet AS number capability Type: Support for 4-octet AS number capability (65) Length: 4 AS Number: 34932 Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 6 Capability: Support for Additional Paths Type: Support for Additional Paths (69) Length: 4 AFI: IPv4 (1) SAFI: Unicast (1) Send/Receive: Receive (1) Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 26 Capability: FQDN Capability Type: FQDN Capability (73) Length: 24 Hostname Length: 22 Hostname: fw01.lab.netravnen.org Domain Name Length: 0 Domain Name: Optional Parameter: Capability Parameter Type: Capability (2) Parameter Length: 4 Capability: Graceful Restart capability Type: Graceful Restart capability (64) Length: 2 [Expert Info (Chat/Request): Graceful Restart Capability supported in Helper mode only] [Graceful Restart Capability supported in Helper mode only] [Severity level: Chat] [Group: Request] Restart Timers: 0x0078 0... .... .... .... = Restart: No .... 0000 0111 1000 = Time: 120
Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd
-------- Forwarded Message -------- Subject: Fwd: [dev] Problems regarding BGP code 2, sub-code 7 when peering with Cisco IOS-XR Version 4.2.3 over IPv6 Date: Thu, 19 Oct 2017 12:34:05 +0200 From: Christoffer Hansen <netravnen@gmail.com> To: Daniel Walton <dwalton@cumulusnetworks.com> CC: FRRouting-Dev <dev@lists.frrouting.org>
But yes.
All the fuzz is the fault of the Cisco IOS-XR platform not supporting the add-path capability for eBGP peerings :/
Add path is not be supported with MDT, tunnel, and L2VPN address families and eBGP peerings. https://www.cisco.com/c/en/us/td/docs/routers/crs/software/ crs_r4-2/routing/configuration/guide/b_routing_cg42crs/b_routing_cg42crs_ chapter_01.html
Cisco has only implemented iBGP support for the add-path functionality (do not know if they have done something different in IOS-XR 6.x releases)
Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd
-------- Forwarded Message -------- Subject: Re: [dev] Problems regarding BGP code 2, sub-code 7 when peering with Cisco IOS-XR Version 4.2.3 over IPv6 Date: Tue, 17 Oct 2017 14:48:40 +0200 From: Christoffer Hansen <netravnen@gmail.com> To: Daniel Walton <dwalton@cumulusnetworks.com> CC: FRRouting-Dev <dev@lists.frrouting.org>
Any chance you can get a .pcap of the session that is bouncing?
Refer to attached file. "my-packetcapture.cap"
----
Had the dreary experiencing today (again) when trying to setup a HE (full feed) BGP tunnel between the pfSense FRR daemon and HE Frankfurt BGP endpoint.
Refer to attached file. "henetv6-bgp-tunnel-packetcapture.cap"
----
Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd On 9/26/2017 20:19, Daniel Walton wrote:
Hi Christoffer, FRR will always advertise the capability for "RX addpath" but we will only advertise "TX addpath" if you configure one of the "neighbor x.x.x.x addpath...." knobs. In your case it sounds like XR is getting confused about us sending the "RX addpath" capability on a v6 session. That shouldn't cause it to send a NOTIFICATION though so I am wondering if maybe we are formatting something incorrectly in the OPEN. Any chance you can get a .pcap of the session that is bouncing?
thx Daniel
On Tue, Sep 26, 2017 at 12:06 PM, Christoffer Hansen <netravnen@gmail.com <mailto:netravnen@gmail.com>> wrote:
FRRouting-Dev <dev@lists.frrouting.org <mailto:dev@lists.frrouting. org>>
Hit an interesting issue today. (for reference a lot of technical details below)
I found myself unable to locate the option of turning BGP code 2, sub-code 7 off when sending capabilities to a neighbor. (Spent some time googling around but mostly found Cisco IOS-XR related stuff)
It appears Cisco IOS-XR does not yet support the use off 'additional-paths' (BGP code 2, sub-code 7) when exchanging neighbor capabilities. But ONLY for IPv6 (IPv4 is supported).
So my question to the list (if anyone finds the time to answer) is: Does FFRouting contain an option to turn off the multi-path feature / specific sub-code when announcing BGPv4 capabilities to it's neighbor(s) over IPv6 (or both IPv4/v6) ?
Nb: And yes. Have tried disabling sending capabilities to the IOS-XR router altogether. But the the Cisco router just refuses because no capabilities is announced from neighbor.
Nb(2): Capability option is set to 'Dynamic' when announcing to neighbor.
-- Regards, Christoffer. gpg: c8b3 82a8 a1cd cdb7 71fe b24c c654 948f da86 becd
Software Details ================
pfSense v2.3.4 -------------- * Name: frr * Category: net * Version: 0.0.2 * Description: FRR routing daemon for BGP, OSPF, and OSPF6 Conflicts with Quagga OSPF and OpenBGPD. These packages cannot be installed at the same time.
Debug output from Cisco IOS XR Software, Version 4.2.3[Default] ===============================================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::'
RP/0/RSP0/CPU0:Sep 26 16:49:36.532 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Idle to Connect RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Received message from 2001:db8:::250:56ff:febd:7e57 with type 1, length (incl. header) 102 RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: Receive message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.754 MEST: bgp[1048]: [default-iord] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0066 0104 ff4c 0078 5774 0604 4902 0601 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 0100 0102 0280 0002 0202 0002 0641 RP/0/RSP0/CPU0:Sep 26 16:49:36.755 MEST: bgp[1048]: [default-iord] VRF Internet: 0400 00ff 4c02 0645 0400 0101 0102 0242 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0002 0243 0002 1949 1715 6677 3031 2e6c RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 6162 2e6e 6574 7261 766e 656e 2e65 7500 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: 0204 4002 8078 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: Received OPEN from 2001:db8:::250:56ff:febd:7e57, version 4, holdtime 120 secs RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.756 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has MULTIPROTOCOL_EXTENSION capability for afi/safi: 1/1 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability(old) for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has ROUTE-REFRESH capability for all address-families RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.757 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has 4-byte AS capability with AS 65356 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 6 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 Addr-family 1/1 not supported: Ignoring the ADDPATH capability RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 66, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.758 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 2 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 67, length 0 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 25 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has unrecognized capability code: 73, length 23 (ignored) RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has optional parameter type: 2 (Capability) len: 4 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: bgp_io_read_schedule_updgrp: NO updgrp scheduled after Open processing: nbr=2001:db8:::250:56ff:febd:7e57, nbrfl=0x08314080 RP/0/RSP0/CPU0:Sep 26 16:49:36.759 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Connect to OpenSent RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending OPEN to 2001:db8:::250:56ff:febd:7e57, version 4, my as: 31027, holdtime 120 seconds RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: OPEN from 2001:db8:::250:56ff:febd:7e57 has capabilities with no supported address-family. RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: Sending NOTIFICATION 2/7 (unsupported/disjoint capability) to 2001:db8:::250:56ff:febd:7e57 (0 bytes: ) RP/0/RSP0/CPU0:Sep 26 16:49:36.760 MEST: bgp[1048]: [default-iord] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from OpenSent to Closing RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 2001:db8:::250:56ff:febd:7e57 send message type 3, length (incl. header) 21 RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: Send message dump for 2001:db8:::250:56ff:febd:7e57: RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: ffff ffff ffff ffff ffff ffff ffff ffff RP/0/RSP0/CPU0:Sep 26 16:49:36.761 MEST: bgp[1048]: [default-ioct] VRF Internet: 0015 0302 07 RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 went from Closing to Idle RP/0/RSP0/CPU0:Sep 26 16:49:36.762 MEST: bgp[1048]: [default-event] VRF Internet: 2001:db8:::250:56ff:febd:7e57 reset due to BGP Notification sent
Output from pfSense FRR routing daemon ======================================
* NOTE(1): IPv6 network prefix replaced with '2001:db8::' * NOTE(2): IPv4 next-hop replaced with TEST-NET-3 address 203.0.113.4
BGP neighbor is 2001:db8::1, remote AS #ISP-ASN#, local AS 65356, external link BGP version 4, remote router ID 0.0.0.0 BGP state = Idle Last read 00:00:27, Last write 00:00:11 Hold time is 120, keepalive interval is 40 seconds Message statistics: Inq depth is 0 Outq depth is 0 Sent Rcvd Opens: 4 0 Notifications: 0 4 Updates: 0 0 Keepalives: 0 0 Route Refresh: 0 0 Capability: 0 0 Total: 4 4 Minimum time between advertisement runs is 0 seconds Update source is 2001:db8::250:56ff:febd:7e57
For address family: IPv4 Unicast Not part of any update group Community attribute sent to this neighbor(extended) 0 accepted prefixes
Connections established 0; dropped 0 Last reset 00:00:27, due to NOTIFICATION received (OPEN Message Error/Unsupported Capability) Local host: 2001:db8::250:56ff:febd:7e57, Local port: 57277 Foreign host: 2001:db8::1, Foreign port: 179 Nexthop: 203.0.113.4 Nexthop global: 2001:db8::250:56ff:febd:7e57 Nexthop local: fe80::250:56ff:febd:7e57 BGP connection: shared network BGP Connect Retry Timer in Seconds: 120 Next start timer due in 5 seconds Read thread: off Write thread: off
_______________________________________________ dev mailing list dev@lists.frrouting.org <mailto:dev@lists.frrouting.org> https://lists.frrouting.org/listinfo/dev <https://lists.frrouting.org/listinfo/dev>
participants (2)
-
Christoffer Hansen -
Daniel Walton