Either the magnitude or direction change or both change.
It does not obey the ordinary law of algebra.
Force on an object is defined as the product of the mass and the acceleration of the object.
Acceleration is a vector quantity.
Since acceleration is a vector quantity, force is also a vector quantity as force is some scalar constant(mass) multiplied by acceleration(a vector quantity).
Hence, force is vector quantity it has both magnitude and direction.