Skip to content
Go back

The Innovator's Dilemma

Published:  at  08:15 PM
The Firm Under AI

Rethinking corporations, platforms, and power when intelligence becomes infrastructure

4 of 11

The Innovator’s Dilemma

The previous posts established two things.

First, firms expand when internal coordination is cheaper than market contracting. Second, as firms grow, internal coordination costs rise — through bureaucracy, agency drift, and political capital allocation.

The natural prediction follows: when external coordination costs fall, the boundary of the firm should contract.

But in practice, that adjustment is slow.

Large corporations rarely collapse because they are foolish. They struggle because they are optimised — for a cost structure that is shifting beneath them.

This is the core of what Clayton Christensen described as The Innovator’s Dilemma: successful firms are structurally incentivised to ignore changes in relative coordination costs, even when those changes threaten their position.

Not because they cannot see them. But because responding is irrational within their existing incentive system.


Optimised for a Particular Cost Structure

By the time a corporation reaches maturity, it is optimised for:

  • Margin stability
  • Predictable revenue
  • Shareholder expectations
  • Operational efficiency
  • Risk management

These are rational optimisations — given the cost structure under which the firm was built.

When the firm was established, internal coordination was cheaper than the alternatives. Its processes, incentives, and capital allocation systems were designed for that world.

But disruption rarely looks like a better version of the current arrangement.

It looks:

  • Smaller
  • Lower margin
  • Technically inferior
  • Uncertain

From the perspective of the incumbent, ignoring it is often rational — because the existing incentive system was calibrated for conditions that are changing.


The Structural Trap

Consider a large firm with a $10B revenue base.

A new market appears worth $50M — enabled by cheaper external coordination, lower transaction costs, or new digital infrastructure.

Even if it grows rapidly, it is immaterial to current performance.

Worse, it may cannibalise existing revenue.

Internal incentives align against it.

The organisation protects its core.

The new entrant grows in the margins — often using lighter coordination structures, lower overhead, and external networks rather than internal hierarchy.

This is not incompetence.

It is structural logic: the incumbent’s internal coordination costs are optimised for scale, not for adaptation.


Metrics as Boundary Reinforcement

Large organisations rely on metrics to coordinate at scale.

But metrics also filter attention — and they reinforce the existing boundary of the firm.

If performance dashboards emphasise:

  • EBITDA
  • Gross margin
  • Cost discipline

Then experimental, low-margin initiatives that might shift the firm’s boundary appear unattractive.

Measurement systems reinforce current optimisation. As explored in Metrics Are Projection, metrics do not merely measure performance — they shape behaviour.

Disruption often requires temporarily degrading the very metrics that define success. Few systems are designed to reward self-disruption.

This is an internal coordination problem: the firm’s own measurement infrastructure prevents it from responding to changes in the external cost structure.


Organisational Memory as Inertia

Established corporations accumulate:

  • Processes
  • Compliance structures
  • Vendor relationships
  • Cultural norms

These are forms of organisational memory.

Memory increases reliability. It reduces internal transaction costs by encoding decisions that would otherwise need to be made repeatedly.

But memory also increases inertia. Every encoded process represents an assumption about the cost structure — an assumption that may no longer hold.

Startups are not just smaller. They are less burdened by memory. They can organise around current coordination costs rather than historical ones.

This asymmetry compounds over time.


Capital Markets and Time Horizons

Public corporations operate under capital market scrutiny.

  • Quarterly reporting creates visibility
  • Visibility creates expectation
  • Expectation creates pressure

Even when leadership recognises long-term strategic threats, short-term performance variance can be penalised.

This narrows strategic optionality.

Resource allocation becomes shaped by reporting cycles and investor expectations rather than by shifts in the underlying cost structure.

Smaller private firms, or entrants backed by patient capital, operate under different temporal constraints. They can organise around emerging coordination economics before incumbents can justify the internal disruption required to respond.

The divergence is not ideological. It reflects differing capital structures and incentive environments.


When Adaptation Requires Cannibalization

The hardest strategic move for a mature firm is self-cannibalisation.

Launching a new product that:

  • Undercuts pricing
  • Simplifies features
  • Targets lower-tier customers
  • Reduces short-term profitability

This conflicts with internal success metrics.

Startups do not face this tension. They have no core to protect.

The incumbent must choose between:

  • Defending the present boundary
  • Rebuilding for a different cost structure

And incentives often favour defence.


Structural Fragility

Optimisation increases efficiency.

But optimisation narrows flexibility.

A highly optimised system can become fragile when conditions change.

The large managerial corporation was optimised for:

  • Stable demand
  • High information asymmetry
  • Expensive external coordination
  • Predictable supply chains

These are precisely the conditions that are shifting. When coordination becomes cheaper, when information becomes abundant, when external networks become viable — the assumptions embedded in the organisation no longer match the environment.

Not collapse.

But increasing adaptation pressure.


Why This Matters for What Follows

The innovator’s dilemma is not just a strategy problem.

It is a boundary problem.

When external coordination costs fall, the optimal boundary of the firm shifts inward. Functions that were once cheaper to perform internally become cheaper to coordinate externally.

But firms cannot adjust their boundaries freely. Their incentive systems, metrics, capital allocation processes, and organisational memory all resist the shift.

This is why boundary adjustment happens unevenly — and why new entrants, platforms, and lighter coordination structures can gain ground even against well-managed incumbents.

The next post examines what happens when digital infrastructure materially reduces external coordination costs — and the boundary of the firm begins to move.