Change in speed would continue as long as an unbalanced force is applied.
Unbalanced forces acting on an object brings it in motion. The direction of motion is along the direction of greater force. If an unbalanced force is applied on the object, there will be a change either in its speed or in the direction of its motion. Thus, to accelerate the motion of an object, an unbalanced force is required. And the change in its speed (or in the direction of motion) would continue as long as this unbalanced force is applied.