article
Four Boundaries for Making Transformer Runtime Research Measurable
A sequence of transformer runtime experiments is easier to reason about when each step turns hidden model behavior into an explicit system boundary.
5m read
Building thoughtful software with AI.Notes from the systems behind the work.
A sequence of transformer runtime experiments is easier to reason about when each step turns hidden model behavior into an explicit system boundary.
Transformer middle-layer replacement should be framed as a measured transition-system experiment, not as a blanket claim that one recurrent block can replace the middle of a model.