When to Take Off your Training Wheels