Generative AI Fundamentals Map
Map/Algorithms and learning/Wave 6

Weight-level continual learning

Lessons move from the context window into the model itself.

capabilityEmerging Open on the map →

Facts

Lane
Algorithms and learning
Wave
6 of 12 (build order, not a date)
Needs
0 boxes all the way back through hard links
Unlocks
3 boxes downstream through hard links
Leverage
0.5 points · stands in the way of 2 of 53 stages · rank 16 of 57
Cluster
Agents at work

Evidence as of October 2026

"There is no pathway from context to weights" yet. Titans and Nested Learning are early attempts at models that update while they run.

  1. 01Are we in a continual learning overhang? (LessWrong, Jan 2026)
  2. 02Zvi on Dwarkesh Patel and continual learning

Around it

Needs · 0

Nothing beyond the detail list. It can start at any time.

Unlocks · 2

Loops and off-ramps

Openings researchers' judgement, October 2026 scouting

Startup room 52/100 · rank 26 of 124 Research room 57/100 · rank 37 of 124
Crowding3 Lab overlap5 Small-team fit3 Buyer today3 Research openness4
Depth
deep
Players
Adaption Labs ($50m); Trajectory ($15m seed, then $40m at $300m); SSI (~$8bn); Thinking Machines (Tinker); Google Titans
Wedge
Systems layer for learning from production feedback on open weights: adapter updates gated against regressions, forgetting and poisoning, with rollback and a learning-over-time eval. startup
  1. 01Pulse 2.0: Trajectory $15m
  2. 02TBPN: Adaption Labs $50m
  3. 03FutureSearch: neolabs forecast