If you applied a force at right angles to the motion,
you would turn the velocity to the direction of the force.
If you have a rock on a string, and give it a few whirls around,
the applied force (tension of the string) is always at right angles to the motion, and it goes in a circle.