This opposite behaviour is due to the opposite behaviour of magnetic dipole as compared to electric dipole. When the paramagnetic substance is kept in magnetic field, the direction of magnetic field at the centre of magnetic dipole of substance is along the direction of magnetic moment which is opposite to the case of dipole in electric field. Also, when paramagnetic substance is kept in the magnetic field then its magnetic dipole aligns in the direction of field. Thus, magnetic field due to the magnetic dipole adds up to the applied magnetic field.
Hence, an extra magnetic field produced in the direction of applied field.