Success story

Scaling Horizontally and Removing Limitations with Basis and HAProxy

Bessere Leistungsfähigkeit
Erweiterte
Sicherheit
SLAs
übertroffen
Kosteneinsparung
Success story

Scaling Horizontally and Removing Limitations with Basis and HAProxy

Bessere
Leistungsfähigkeit
Erweiterte
Sicherheit
SLAs
übertroffen
Kosteneinsparung

Integration with all major ad services.

11 years of market leadership.

Providing services across North America, South America, and Europe.

About Basis

Basis Technologies, formerly operating as “Centro,” is a leading provider of cloud-based workflow automation and business intelligence software for marketing and advertising functions within enterprises. Its SaaS platform is composed of a suite of integrated applications that automate manual operations, standardize business processes, and improve marketing and advertising performance. The technology provides a comprehensive selection of buying methods across all channels and devices, utilizing all major creative types and formats. Basis platform creates a single system of record, seamless team collaboration, and actionable data-driven insights yielding material gains in productivity and increased profitability for users. Headquartered in Chicago with offices providing services to North America, South America and Europe, Basis Technologies has received numerous accolades for its commitment to employees and workplace culture.

Ergebnisse auf einen Blick

Bessere
Leistungsfähigkeit
Erweiterte
Sicherheit
SLAs
übertroffen
Kosteneinsparung

The Challenge

Back in 2014/2015 Basis was using hardware appliances for load balancing hundreds of thousands of QPS (Queries Per Second) reaching its DSP (Demand Side Platform) endpoints. The rising demand of QPS and the industry moving into securing the exchange of data in transit have introduced new challenges for scaling the load balancing layer.

Production Operations Team needed to reassess the requirements for the future of their platform and for scaling the load balancers effectively. At that point, scaling with hardware appliances was deemed ineffective. It would incur a significant increase in costs with limited vertical scalability. In addition to that, to support secure traffic through HTTPS, network topology changes would be required, which would introduce increased response times.

The Objectives

The objectives were simple:

  • Find an effective way to scale load balancing, horizontally vs. vertically.
  • Remove limitations on the network, keeping high performance and low latency as fundamental aspects for the setup.

The following is one of the comparisons Production Operations Team has made in the past while researching options:

Cost
Software Load Balancer - HAProxy Hardware Load Balancer
  • Software load balancers can run on any server instance, whether a VM, commodity hardware or a high-end CPU server (bare metal, virtual, containers, and cloud platforms)
  • Must be overprovisioned
  • Extra features incur licensing costs
  • TCO (Total Cost of Ownership) is higher
  • Need a specialist to maintain
Scalability & Elasticity
Software Load Balancer - HAProxy Hardware Load Balancer
  • Software scales better
  • Can scale real-time
  • Simply add another instance
  • No Elasticity
  • Limited Vertical Scalability (+inflated cost)
  • Simply adding another hardware does not add to capacity, network changes are required
Functionality & Flexibility
Software Load Balancer - HAProxy Hardware Load Balancer
  • Many traffic routing capabilities
  • Variety of health checking
  • Dynamic configuration changes, use APIs, sockets, hitless reloads
  • Scriptable load balancers, LUA
  • Limited functionality
  • Complex configuration
Security
Software Load Balancer - HAProxy Hardware Load Balancer
  • Can work as a shield, WAF, traffic filter
  • Dynamic ACL updates, Antibot, reCAPTCHA v2
  • Extra security features require additional investment, whether hardware or software (IDS/IPS, etc.)
Maintenance & Patching
Software Load Balancer - HAProxy Hardware Load Balancer
  • Easy as with any other software: take out of rotation, patch, back to rotation
  • If one crashes – put another one in
  • Changes can be tested out of production
  • Always carries risks of things going sideways
  • Firmware upgrades are nightmares
  • Cannot test a change unless extra not used pair of load balancers are available
Performance
Software Load Balancer - HAProxy Hardware Load Balancer
  • Network topology changes are not required
  • Can do Layer 3 through Layer 7
  • HTTPS!
  • Network setup may require flowing the entire server traffic through the load balancer
  • Can do only Layer 3 & Layer 4
  • HTTPS on hardware load balancers is simply a no-go
Cloud friendly
Software Load Balancer - HAProxy Hardware Load Balancer
  • Yes
  • Across multiple data centers and hybrid/multi-cloud
  • N/A
Monitoring & Observability
Software Load Balancer - HAProxy Hardware Load Balancer
  • Extensive amount of metrics is exposed
  • HTTP, Unix sockets, 3rd party tools from the community
  • Different ways of doing logging and further analyses
  • Take the pcap at right away
  • Integrations with 3rd party monitoring tools & systems
  • Limited
  • No easy way to filter pcap
  • SNMP
Integrations
Software Load Balancer - HAProxy Hardware Load Balancer
  • Kubernetes, Microservices/Docker/Container-ready, etc.
  • N/A
Extra
Software Load Balancer - HAProxy Hardware Load Balancer
  • Geolocation Support
  • Other first-party tools from HAProxy Enterprise
  • N/A
Cost
Software Load Balancer - HAProxy
  • Software load balancers can run on any server instance, whether a VM, commodity hardware or a high-end CPU server (bare metal, virtual, containers, and cloud platforms)
Hardware Load Balancer
  • Must be overprovisioned
  • Extra features incur licensing costs
  • TCO (Total Cost of Ownership) is higher
  • Need a specialist to maintain
Scalability & Elasticity
Software Load Balancer - HAProxy
  • Software scales better
  • Can scale real-time
  • Simply add another instance
Hardware Load Balancer
  • No Elasticity
  • Limited Vertical Scalability (+inflated cost)
  • Simply adding another hardware does not add to capacity, network changes are required
Functionality & Flexibility
Software Load Balancer - HAProxy
  • Many traffic routing capabilities
  • Variety of health checking
  • Dynamic configuration changes, use APIs, sockets, hitless reloads
  • Scriptable load balancers, LUA
Hardware Load Balancer
  • Limited functionality
  • Complex configuration
Security
Software Load Balancer - HAProxy
  • Can work as a shield, WAF, traffic filter
  • Dynamic ACL updates, Antibot, reCAPTCHA v2
Hardware Load Balancer
  • Extra security features require additional investment, whether hardware or software (IDS/IPS, etc.)
Maintenance & Patching
Software Load Balancer - HAProxy
  • Easy as with any other software: take out of rotation, patch, back to rotation
  • If one crashes – put another one in
  • Changes can be tested out of production
Hardware Load Balancer
  • Always carries risks of things going sideways
  • Firmware upgrades are nightmares
  • Cannot test a change unless extra not used pair of load balancers are available
Performance
Software Load Balancer - HAProxy
  • Network topology changes are not required
  • Can do Layer 3 through Layer 7
  • HTTPS!
Hardware Load Balancer
  • Network setup may require flowing the entire server traffic through the load balancer
  • Can do only Layer 3 & Layer 4
  • HTTPS on hardware load balancers is simply a no-go
Cloud friendly
Software Load Balancer - HAProxy
  • Yes
  • Across multiple data centers and hybrid/multi-cloud
Hardware Load Balancer
  • N/A
Monitoring & Observability
Software Load Balancer - HAProxy
  • Extensive amount of metrics is exposed
  • HTTP, Unix sockets, 3rd party tools from the community
  • Different ways of doing logging and further analyses
  • Take the pcap at right away
  • Integrations with 3rd party monitoring tools & systems
Hardware Load Balancer
  • Limited
  • No easy way to filter pcap
  • SNMP
Integrations
Software Load Balancer - HAProxy
  • Kubernetes, Microservices/Docker/Container-ready, etc.
Hardware Load Balancer
  • N/A
Extra
Software Load Balancer - HAProxy
  • Geolocation Support
  • Other first-party tools from HAProxy Enterprise
Hardware Load Balancer
  • N/A

The Solution

That is when the team started thinking about software load balancers. The team was no stranger to HAProxy – most of the members were well-acquainted with the software. However, they were not expecting the scalability scenario, functionality, control, and flexibility gains that HAProxy brought to the table.

„We had a very tiny deployment of HAProxy, which was used for load balancing some really insignificant amounts of traffic, and it worked splendidly. With the technology we had at the time, we started benchmarking it based on our use-case,“ said Eduard Rushanyan, Director of Production Operations for Basis Technologies.

Basis Technologies has received numerous accolades for its commitment to employees and workplace culture.

The benchmarks the team performed were showing promising results from a performance standpoint, especially when it came to securing traffic using HTTPS. With the help of the HAProxy community, Basis was able to optimize their load balancer deployment to maximize the performance of their CPUs. At that point, their software solution was running laps around their previous hardware deployment, so the team decided to embrace HAProxy Enterprise as the way forward.

After receiving recommendations from HAProxy Technologies, the team then implemented several Enterprise features such as EBGP with route health injection, Lua lookups, and map files to optimize the traffic flow and have better control over it.

The Results

The results were everything that the team was expecting. HAProxy Enterprise’s adaptability and scalability proved to be just what their setup needed, handling increased secure traffic with ease even with the initial configuration.

While the rigidity of hardware boxes had been the standard in the industry for a while, the move to HAProxy turned out to be worth the time and effort. Backed by the HAProxy Technologies support team, Basis has been able to quickly adapt to anything that has been thrown at them in the years since switching.

„We moved away from hardware load balancers, and we have only scratched the surface of what HAProxy Enterprise can provide us. We see up to 50% room to grow with further optimization and we are excited to see what else we can automate and improve on the current setup,“ said Eduard Rushanyan.

Today, Basis is processing millions of QPS and hundreds of gigabytes per second of traffic across globally distributed data centers and cloud systems using HAProxy.

Interested to learn more about HAProxy use cases? Explore our Success Stories page.

Wenden Sie sich an unsere HAProxy Experten, die Ihnen helfen können die bestmögliche Lösung hinsichtlich Bereitstellung, Skalierung und Sicherheit zu finden.