Yes, the Earth would have been incredibly cold at the night and extremely hot during the day if the atmosphere was not present. The light and heat emitted by the Sun is absorbed by the atmosphere and some part of it is reflected back. This helps to keep the day temperature to an optimum value. During night, the heat trapped by the atmosphere helps the keep the temperature warm which prevents excessive lowering of temperature. Thus, in the absence of atmosphere, temperature of Earth will be very hot during the day and extremely cold during the night.