1.1 · Agile Fundamentals
Core idea
Agile is an empirical approach to complex work — deliver value in small slices, inspect results, adapt. It is a family of practices, not a methodology. The word is best read as an adjective describing an organization's response to uncertainty, not as the name of a process.
Historical context
In 1986 Takeuchi and Nonaka published The New New Product Development Game in Harvard Business Review, describing how Japanese firms — Honda, Canon, Fuji-Xerox — used overlapping, self-organizing teams instead of phased hand-offs. This is where the metaphor of "rugby scrum" enters the literature.
Through the 1990s, multiple lightweight methods emerged as responses to the perceived failure of heavyweight process standards (CMM, ISO 9001-style process audits, RUP in its most cumbersome form). Ken Schwaber and Jeff Sutherland developed Scrum. Kent Beck created Extreme Programming. Alistair Cockburn developed Crystal. Jim Highsmith created Adaptive Software Development. Jon Kern and others were practicing Feature-Driven Development.
In February 2001, seventeen practitioners met at the Snowbird resort in Utah to find common ground. They produced the Manifesto for Agile Software Development: four value statements and twelve principles. The Manifesto is deliberately short, deliberately prescription-free, and deliberately signed by individuals, not institutions.
What is worth understanding is what the Manifesto was against: the assumption that software engineering could be treated as a predictive discipline like civil engineering — that you could specify a system exhaustively upfront and contract its delivery. Many of the signatories had spent the 1990s watching six-figure consulting engagements produce 500-page specifications for systems that shipped late, missed the need, or never shipped at all. The Manifesto is a reaction to a specific failure pattern.
Key frameworks & mental models
The four values prefer:
- People and interaction over process and tools
- Working product over exhaustive documentation
- Customer collaboration over contract negotiation
- Responding to change over following a plan
Read carefully: the right-hand side is not rejected, only de-prioritized. This is constantly misread.
The twelve principles (condensed into five clusters):
- Delivery rhythm — early, continuous, short-cycle delivery; working software as primary measure of progress.
- Collaboration — business and developers daily; face-to-face as the best communication channel.
- People — motivated individuals; trust and support; self-organizing teams.
- Craft — technical excellence and good design enhance agility; simplicity as essential.
- Learning — reflect and adjust at regular intervals.
Empirical process control (three pillars from Schwaber/Sutherland):
- Transparency — everyone sees the same reality.
- Inspection — regular checks against the goal.
- Adaptation — change behavior when inspection reveals a gap.
Iterative vs incremental — iterative = revisiting the same slice to improve it; incremental = adding new slices. Good agile teams do both simultaneously. This distinction is why "iterating" is not the same as "progressing."
Cynefin in one paragraph (previewed here; expanded in L4). Agile is best-suited to the Complex domain, where cause-and-effect is only clear in retrospect. For Clear and Complicated domains, predictive methods often work better and faster. The practitioner's job is to read the domain, not apply agile universally.
Primary sources — the canon
- The Agile Manifesto and Twelve Principles (agilemanifesto.org) — the primary document. Twenty minutes to read; returned to for a lifetime.
- The New New Product Development Game (Takeuchi & Nonaka, 1986, HBR) — pre-Manifesto origin.
- The Scrum Guide (Schwaber & Sutherland; current edition) — the primary framework document for Scrum.
- Agile Software Development: The Cooperative Game (Cockburn) — best single book on agile as a human practice.
- Agile Estimating and Planning (Cohn) — the canonical reference for practical planning.
- More Agile Testing (Crispin & Gregory) — for integrated quality.
- The Age of Agile (Denning) — managerial framing for executives.
Trade-offs & criticism
- Agile is over-applied. In domains that are genuinely Clear or Complicated (regulatory reporting implementations, mainframe migrations with known inputs), predictive planning is often faster and cheaper. Using agile universally is cargo-culting.
- Agile is degraded in adoption. The industry term "dark agile" or "dark scrum" (Jeffries) describes coercive applications where ceremonies are kept and autonomy stripped. The teams now do the overhead of agile and none of the benefit.
- Agile does not scale mechanically. Scaling frameworks exist because scaling is a real and separate problem (covered in L3). Believing that "agile principles" scale by themselves is the single most common failure mode at large organizations.
- The "mindset" framing is unfalsifiable. "You're not really agile" is used to defend any framework against any criticism. A practitioner should notice when this move is being made.
- Post-Manifesto debates matter. Ron Jeffries (signatory) has publicly argued that "SAFe is not agile" and that most agile implementations have departed from the Manifesto's intent. Martin Fowler gave a 2018 talk called The State of Agile Software in 2018 making a similar argument. These are serious voices, not outsider grievances.
Worked example
A 14-person claims-processing team at a European insurer was told to "go agile." Leadership imported Scrum wholesale: 2-week sprints, daily standups, Product Owner role assigned to the claims operations lead (who was already managing 140 people).
What happened in practice.
- The "Product Owner" attended Sprint Planning once a month and delegated backlog refinement to a junior BA.
- The Sprint Goal became "complete all stories in the sprint."
- Daily standups became status reports to the team lead.
- Velocity was adopted as a target; estimates inflated; actual throughput was unchanged.
- Retrospectives surfaced the same complaint for six sprints — "we can't make decisions" — and no action was taken.
What was wrong.
- The empirical pillars were all violated. Transparency was theater (dashboards, not honesty). Inspection was suppressed (retro items died on the list). Adaptation required decision rights the team did not have.
- Scrum was not the fix; the fix was to restore the authority to make local decisions, which was never actually transferred. The ceremonies were imposed without the autonomy.
What should have happened.
- Before adopting Scrum, diagnose whether the work is Complex (needs empirical control) or Complicated (might prefer predictive). Claims processing often sits in the Complicated domain, where Kanban-style flow is usually superior to Scrum.
- Give the team real decision authority before demanding new ceremonies.
- Measure outcomes (claim cycle time, rework rate, customer satisfaction) and not ceremony compliance.
Challenge questions
- A team reports "we're agile — we do standups daily." What's missing from that claim, and what four clarifying questions would you ask?
- Give a concrete example where waterfall is the correct choice over agile. What makes it correct in that case?
- A stakeholder says "agile means we don't need requirements." How do you correct this without alienating them?
- The Manifesto values "working software over comprehensive documentation." A regulated bank needs a complete audit trail. Are these in conflict? Why or why not?
- Ron Jeffries has argued that most agile implementations have departed from the Manifesto's intent. Summarize his argument fairly, even if you disagree.
- What is the distinction between being agile and doing Agile, and why does it matter to leaders?
- Your team has shipped every sprint for a year; stakeholder satisfaction is declining. What went wrong?
Mini case
Your team ships quarterly, has a 120-page requirements document signed off, and leadership wants to "go agile" by adding a daily standup. Budget approval happens annually; contracts are fixed-price; legal review gates every release.
Write a one-page memo to leadership that (a) names what they are actually asking for, (b) explains what would have to change beyond standups, and (c) proposes three sequenced moves for the next 90 days that are achievable without upending the operating model.