This is because at steady state the conductor surface is equipotential surface and charges don't flow. Now if there is a component parallel to surface then there will be a potential difference along the surface. That will also cause the flow of current along the direction of potential difference. So there should not be any component parallel to the conductor surface at the surface. That's why the fields are perpendicular to the surface.