The temperature outside our body becomes very low. But as we are homoeothermic (warm blooded) we need to maintain our body temperature. Shivering with cold are nothing but sudden contraction and movement of body muscles. This movement generates lot of heat which increases our body temperature and we feel warm.
For this reason even though we are shivering in cold our body temperature is already high.