Chapter 9
What do three agent-assisted implementations teach us about web scalability?#
- Created
- Updated
Scalability is the ability to keep a system useful while its conditions change. The three implementations show how application behavior, the cost of change, and the development workflow constrain one another. Use their evidence to choose an architecture and workflow for a stated future scenario.
9.1 One system, three connected loops#
A scaling response changes the application and becomes a development task. The development workflow determines whether people and agents can implement it safely; the resulting system creates the next set of observations.
9.1.1 The application loop: respond to pressure#
Changing demand challenges an architectural assumption. Measurements locate the first limit, and a response changes capacity, correctness, or recovery behavior. Trace which signal identified the limit and what new failure mode or operating cost the response introduced.
9.1.2 The development loop: preserve the ability to change#
Each response must be implemented, checked, and maintained. Contracts, tests, setup, and project knowledge determine how expensive that work becomes. Identify what made the change difficult and which lesson became an executable check or maintained decision record.
9.1.3 The agentic loop: turn execution into accepted change#
9.2 How the loops affect one another#
Consider adding a queue to protect event ingestion during a traffic spike. The response affects all three loops:
| Perspective | Consequence of the queue |
|---|---|
| Application loop | Burst absorption improves, but freshness lag, backlog growth, duplicates, and worker saturation become possible |
| Development loop | The project gains worker code, retry and idempotency rules, new local setup, deployment, tests, and ownership |
| Agentic loop | Tasks may decompose around producer, consumer, and verification boundaries, but their shared event contract must settle first |
| Evidence connecting all three | Queue age, end-to-end event visibility, duplicate rate, failure recovery, review effort, and trace history show whether the response worked |
A faster request path may leave events waiting longer for processing and make the system harder to operate. Evaluate both the pressure relieved and the new obligations.
Sustainability angle
Which additional computation, storage, bandwidth, and human attention produced useful capacity or learning? Count waste displaced into backlog, retries, review, and maintenance as part of the response's cost.
9.3 Apply the map to the three implementations#
A establishes the local single-agent baseline, B rebuilds the same required behavior with a foundation-model single agent, and C introduces fleet orchestration. The common brief and protocol make their differences inspectable. They do not isolate every cause: the team learns between builds, and architectures, tools, hardware, optional scope, or reporting may differ. Record those differences when interpreting a result.
9.3.1 Build the evidence matrix#
Compare the implementations across the same dimensions.
For each dimension, record evidence from implementations A, B, and C—or explicitly state not measured—before answering the comparison question.
| Evidence dimension | Collect from each implementation | Compare across implementations |
|---|---|---|
| Accepted browser behavior | Acceptance results, escaped defects, and correction evidence | Which differences affected users rather than only repository structure? |
| Architecture and contracts | Request trace and key boundary decisions | Which boundaries made independent change safer or harder? |
| Pressure and saturation | Pressure map and first predicted or observed limit | How did each architecture respond to the same growth scenario? |
| Measurement and recovery | Benchmark, operational signals, and recovery result | What was directly observed, and what remained invisible? |
| Development friction | Cross-team audit and change effort | Which setup, test, or coupling cost would dominate the next change? |
| Human–agent workflow | Execution trace, interventions, and review effort; include handoffs and backlog for the fleet | Which allocation produced accepted work at a sustainable correction cost? |
| Resource use and externalities | Runtime and model-use evidence | Did added resources create useful capacity or quality, or merely more activity? |
Do not turn absent evidence into a favorable score. If a build was not load-tested, state that its saturation behavior is proposed rather than observed. If model usage was not captured, do not infer efficiency from elapsed time. If implementation C produced more branches but required more review and correction, count both the activity and the acceptance cost.
9.3.2 Separate observation, inference, and proposal#
A strong synthesis labels the status of each important claim:
- Observed: directly inspected or measured in a repository, running application, audit, test, trace, or recorded workflow.
- Inferred: a plausible explanation for an observation, with alternatives and confounding factors kept visible.
- Proposed: a future response or target design that was not implemented and validated in the compared build.
For example, “implementation B had the lowest measured p95 under the declared workload” is an observation. “Its data model caused the difference” is an inference unless the comparison isolates that factor. “A queue would protect its write path” is a proposal until the new behavior and trade-offs are tested. This vocabulary lets you reason beyond the available experiment without presenting plans as results.
Pause & think
Classify evidence and next steps
Use observation for a reported measurement, inference for an explanation drawn from evidence, and proposal for an action to try. Classify each statement by its role; you are not being asked whether the explanation is true.
Automatically checked practice. Saved answers are private to your account.
Checking saved answers…
Your answers to earlier versions
Show worked answer
Measurements describe what was recorded. A causal explanation goes beyond that observation. A proposed experiment states what to do next and can test the explanation.
9.4 Turn comparison into a decision#
Choose an architecture and development workflow for the stated goals and constraints. Use the matrix to build one argument:
- State the common brief, acceptance core, deliberately varied setup, and comparison limits.
- Trace one consequential result through the application, development, and agentic loops, including a planned-versus-observed decision path.
- Compare the strongest A–B–C evidence, including failures, correction, and resource use; label observations, inferences, and proposals.
- Choose an architecture and workflow for a future scenario, explain rejected alternatives and accepted trade-offs, and name the owner of operational and correction work.
- Identify the first expected saturation boundary, the signal that would reveal it, and what to measure before revisiting the decision.
9.4.1 Field note — Familiarity is part of effective capability#
GPT-family models' communication style is easier for me to follow than Claude's default prose. That personal fit affects how quickly I can review and correct their work; it is not a general model ranking. A model's nominal capability can be less useful if I must first translate its explanations into terms I understand. Changing models therefore changes both the tool and the reviewer's fluency with it, which belongs among the comparison's alternative explanations.
9.4.2 Final reflection package builder#
The builder assembles evidence already produced during the course. Select the artifacts you have, then use its outline to find claims that still lack support.
Final reflection package
Build a reflection from course artifacts
9.5 Project artifact#
Complete the evidence matrix and final decision narrative within the Compare submission. Use the argument above to connect existing artifacts, mark missing evidence and remaining risks, and defend the next decision.
9.6 Author perspective — Learn where to look#
I do not expect you to become an expert in every topic covered here. I want the book to help you recognize which questions deserve attention and where to learn more. An agent can produce a plausible implementation quickly, but you still need to notice the product, architecture, accessibility, security, operational, and maintenance concerns it leaves unresolved.
Like in art, part of the skill is knowing where to look. Sustainability is easy to ignore if it is absent from your mental map. Recognizing it as a concern tells you when to ask a better question, gather evidence, or seek expertise.
Developing this book has also exposed gaps in my understanding. Learning how to question claims, compare evidence, and revise a judgment is a skill I expect to keep practicing as tools and assumptions change.
9.7 Summary#
An engineering decision connects the pressure a system can handle with the team's ability to change and operate it. Defend that decision with the three implementations' evidence, explain its limits, and leave the next team a signal and correction path they can use.