Problem
You are tasked with distributing a very large file, currently stored in cloud object storage, to 1000 servers located within a single data center.
- The Wide Area Network (WAN) link connecting the cloud storage to the data center has a total bandwidth limit of 1 Gb/s.
- Each individual server within the data center has a Network Interface Card (NIC) bandwidth limit of 1 Gb/s.
Task
Design the fastest possible system (achieving the lowest makespan) to stream or deliver this file, ensuring all 1000 servers successfully receive the complete file.
Follow-up
How would your proposed design adapt or change if some of the destination hosts experience poor or unstable network conditions, characterized by slow speeds, packet loss, or frequent disconnections?
AI interview prep
Core dilemma
Maximizing effective throughput across a severely constrained WAN link to multiple internal consumers, while minimizing total delivery time (makespan) and efficiently managing internal network distribution to 1000 hosts.
3 tradeoffs and 3 stress tests locked
Interview prep
Unlock the interviewer X-Ray rubric, tradeoff matrix, stress tests, clarifying questions, and key concepts.
Problem
You are tasked with distributing a very large file, currently stored in cloud object storage, to 1000 servers located within a single data center.
- The Wide Area Network (WAN) link connecting the cloud storage to the data center has a total bandwidth limit of 1 Gb/s.
- Each individual server within the data center has a Network Interface Card (NIC) bandwidth limit of 1 Gb/s.
Task
Design the fastest possible system (achieving the lowest makespan) to stream or deliver this file, ensuring all 1000 servers successfully receive the complete file.
Follow-up
How would your proposed design adapt or change if some of the destination hosts experience poor or unstable network conditions, characterized by slow speeds, packet loss, or frequent disconnections?