Set It And Forget It? Oh, No You Don’t!