Forward / backward micro-batches, weight updates, activation memory and gradient (in)consistency — across pipeline schedules.