The body is moving in circular path because an external force called the centripetal force is acting on it. When the force is removed, the body carries on its journey in the direction of the velocity at that particular instant, which happen to be in tangential direction because in a circular motion the linear velocity is always tangential to the circle in which the body is moving.