A Biography of Wreckage

Hitting Walls

Intelligence is not a straight line. From the 1943 neural switch to today’s scaling limits, Hitting Walls chronicles the structural walls AI has hit—and the radical ladders built to bypass them.

Most AI histories trace the victories. This one maps the wreckage. A guide to understanding the present by deconstructing the past.

PUBLISHED WEEKLY STARTING JAN 17 ON

SUBSCRIBE FOR FREE
The Wreckage
  • 1943 The Biological Wall Logic failed to learn.
  • 1969 The Linear Wall Math failed to separate.
  • 2017 The Sequential Wall Scale failed to read.
  • 2022 The Epistemic Wall Fluency fits the data. It does not fit the truth.
  • 2026 The Energy Wall Intelligence runs out of power.
The Premise

A history of artificial intelligence told through its failures—where confident theories broke, and what those breaks reveal about intelligence, learning, and generality.

The Trap
  • Refuses the "inevitable progress" narrative
  • Rejects the survivor bias of standard tech history
  • Ignores the hype cycle to focus on the physics
The Thesis
  • History told through the wreckage, not the victories
  • Argues that constraints are the engine of intelligence
  • Demonstrates why today’s limit is identical to 1969

W

e like to tell the history of science as a clean ascent. A relay race of geniuses handing off the torch. But this is the classic error of the survivor.

In war, we look at the planes that return, count the bullet holes in the wings, and decide to armor the wings. We forget that the planes hit in the engine never came back to be counted.

This book is about the planes that didn't come back.

Artificial Intelligence did not advance by piling success on top of success. It advanced by crashing. From the Biological Wall of 1943 to the Epistemic Wall of today, every breakthrough was born from a specific, catastrophic failure. To understand the machine you are using today, you cannot just study the winner. You have to study the wreckage that made the winner necessary.

The Map

The Biography of Wreckage

Trace the lineage of machine logic. Each BOXED NODE is a Ladder that scaled the red Wall beneath it—only to hit its own limits at the Wall ahead. The blue labels mark the Dimensions where the tribes diverged before finally converging into Tokens. Trace the history of the climb.

Foundation (1943–1959)

There was a single dream: to copy the brain. But the early models hit wall after wall. The biological neuron was too Rigid, the Perceptron too Linear, and the first deep networks too hard to train. It took a 30-year "Winter" of isolation to build the mathematical ladder out of this hole.

Divergence (1960s–2010s)

To survive the walls of Space, Time, and Complexity, AI had to fracture into specialized tribes. Each architecture was a specific ladder built to scale a specific wall.

Convergence (2017–Present)

The walls crumbled when we realized that images, words, and actions were all just Tokens. The Transformer unified the tribes, but it did not solve the puzzle—it merely industrialised it.

TOKENS ↑
FRAGMENTATION ↑
SPACE ↑ TIME ↑ COMPLEXITY ↑
The Deep History +
Abstraction
Rigidity
Linearity
Scale
Amnesia
Sequence
Dimensions
Fragmentation
Space
Time
Complexity
Tokens
Biological Inspiration
TLU
Perceptron
Deep Belief Nets
PILLAR 1
Seeing
PILLAR 2
Reading
PILLAR 3
Doing
CNNs
LONs
RNNs
LSTMs
Transformers
Q-Learn
Deep RL
Architectural Unification
LLMs & Foundation Models

Hover over the nodes to trace the lineage. Pan and tap the nodes to trace the lineage.

01

The Myth of Progress

Intelligence wasn't built in a straight line. It was built by hitting walls at full speed.

02

The Exile

The founders of deep learning were ignored for decades. They survived on conviction alone.

03

The Unification

Language, Vision, and Action have finally merged. The result is the modern mind.

04

The Next Walls

We have not reached the summit. We are just at the foot of the Energy, Plasticity, and Epistemic walls.

The Timeline

Walls & Ladders

A structural post-mortem in five acts. Tracing the moments where the physics of the architecture forced the field to reroute—from the first rigid gates to the unified fever dreams of today.

Act I: The Foundation
1943

The Rigid Mind

Walter Pitts & Warren McCulloch attempt to map the soul to logic.

1958

The Linear Trap

Frank Rosenblatt's Perceptron hits the first mathematical wall.

Act II: The Wilderness
1986

The Spark in the Dark

The "Conspiracy" of Hinton, LeCun, and Bengio keeps the flame alive.

1998

The Sliding Glass

Yann LeCun teaches a machine to see (CNNs).

1997

The Gate

Schmidhuber & Hochreiter solve the memory problem (LSTMs).

Act III: The Explosion
2012

The Explosion

Scale meets Data: AlexNet conquers ImageNet.

2016

The Strategist

AlphaGo plays Move 37 in Seoul.

Act IV: The Unification
2017

The Attention Span

The Transformer shatters the sequential wall.

Act V: The Reckoning
Present

The Fever Dream

We built a machine that can dream, but forgot to teach it to wake up.

THE CAST

Who Builds the Ladders?

History was rarely made by the comfortable, but by the outcasts who stayed near the wreckage long enough to understand it. These are the architects who refused to negotiate with the wall.

The Outcast Founders

Walter Pitts & Warren McCulloch

A homeless teenager and a philosopher mapping the brain on a kitchen table.

The Showman & The Sceptic

Frank Rosenblatt & Marvin Minsky

Promising the world a machine that could see—right before the math hit back.

The Exiles

Hinton, LeCun, Bengio

The back-injured professor and the "conspiracy" that stayed near the wreckage for decades.

The Strategists

Demis Hassabis & Ilya Sutskever

The video game designer and the scale-engineer who realized that to build a mind, you first have to build an engine.

The Author
The Author

Kanean S A

A tech leader and AI practitioner at the intersection of laboratory research and industrial scale. Having pioneered AI agents for global leaders in BFSI and Healthcare, Kanean is a GTM leader at Google Cloud, where he collaborates with Google’s AI researchers and the world’s most ambitious AI unicorns to shape the future of machine logic.