Looking Back Teaches you Lessons