Scalability
Scalability is a system’s ability to support growing workload while maintaining agreed performance and acceptable resource costs.
Download Markdown (.md)Soroush’s Product Wiki · https://wiki.soroush.uk/topic/scalability/
01What it means
Scalability describes how system behavior changes as demand, data, users, or geographic reach increase. A scalable design can accommodate a defined growth dimension through appropriate resources or structural changes. It is different from being fast at today’s load and from elasticity, which concerns adjusting capacity as demand changes.[1][2]
02Why it matters
Growth can expose bottlenecks that small workloads never reach. Explicit scalability expectations help teams avoid both premature distributed complexity and a product architecture that cannot support credible demand.
03When to use it
Use it when planning launches, large tenants, data growth, or sustained expansion. Define the workload dimension and acceptable costs before choosing technology. If a simpler system meets foreseeable demand with headroom, complexity for hypothetical scale may be unnecessary.
04How it works
- Define growth scenarios and user-facing performance targets.
- Measure current capacity, resource use, and limiting dependencies.
- Identify which components or data structures constrain growth.
- Test capacity changes or architecture options against realistic workloads.
- Track cost per unit of work and re-evaluate as bottlenecks move.
05A practical example
A reporting product handles ten thousand records quickly but slows sharply at one million. Adding application servers does not help because every report scans the same database table. The team changes its query and storage approach, then retests the expected data-growth scenario.
06Where it breaks
No architecture scales without limits or costs. Improving one bottleneck can expose another, and a distributed design adds coordination and operational overhead. Demonstrated capacity under one request mix does not establish capacity under every workload.
Common mistakes
- Calling a fast small-system benchmark evidence of scalability.
- Adding compute before locating the bottleneck.
- Assuming cloud hosting removes database, quota, or budget limits.
07Sources
- Architecture strategies for capacity planningMicrosoft · Official documentationArchitecture strategies for capacity planning
- Architecture strategies for optimizing scaling and partitioningMicrosoft · Official documentationArchitecture strategies for optimizing scaling and partitioning