The magnetic field doesn't go anywhere. We conventionally draw field lines going from North to South, but that's just a convention. So the choice of clockwise vs anticlockwise is just a convention. If we decided field lines went from South to North then the field lines would go anticlockwise not clockwise in the case of direction we need to draw the conventional diagram.