TechPrufer
Get started
Two Sigma
Two Sigma logoTwo Sigma · Feature trail

Highly Available OpenStack Networking

1 post · Sep 2017

What this trail covers

Two Sigma implemented a highly available networking architecture for its on-premise OpenStack private cloud. This involved using VXLAN as an overlay protocol for multi-rack connectivity, VRRP for redundant default gateways, and BGP for advertising routes to external networks. The system was designed to provide tenant networks with 'real' IPs, ensure no single points of failure, and achieve near bare-metal performance. Operational experience and tuning strategies for deployment, troubleshooting, performance, and IP space efficiency were also detailed.

All Two Sigma trails
  1. Highly Available OpenStack Networking: Implementation and ExperienceThis post details the implementation of a highly available OpenStack networking architecture at Two Sigma. Key technical contributions include: the use of VXLAN with hardware offload for overlay networking across racks, the integration of VRRP for redundant default gateway IPs between Neutron gateways, and the use of BGP to advertise tenant network routes to upstream switches for ingress traffic. The post also discusses operational experience, including deployment strategies for Neutron gateways, troubleshooting complexities of overlay networks and VRRP/BGP, and performance tuning related to VXLAN encapsulation, Linux bridges, and MTU settings.