Forget the Past and Press On