Generative AI Fundamentals Map
Map/Loops/reinforcing

Learning from deployment

reinforcing loop · 4 steps · Trace on the map →

The cycle

Agents do real workTraces of what workedAgents learn from themBetter agents get moreworkR
  1. 01Agents do real workLong-horizon agents
  2. 02Traces of what workedTrace capture
  3. 03Agents learn from themContinual-learning agents
  4. 04Better agents get more work

What drives it

Work produces the experience that makes agents better at the work.

What breaks it

It needs a trustworthy signal of what "worked", so it stalls where verification is weak. Today most of the learning lives outside the weights, in files and memory.

What to watch

Whether labs ship weight-level learning from deployment. How fast an agent improves inside one company.

Also feeds it

Sources

  1. 01Silver and Sutton’s Era of Experience (The Decoder)
  2. 02Are we in a continual learning overhang? (LessWrong, Jan 2026)