The importance of small steps for the long run