I have a glass of water at room temperature, kept inside a closed room. I get a hot mug of coffee, keep it on another table, and get so busy I completely forget about it. As the coffee cools down, what happens to the temperature of the glass of water?
The water gets warmer
At the coffee cools down, it slightly increases the hotness of the air in the room. Thus, the room temperature itself increases after some time (say, to ~240C); this means the glass of water is now cooler (~10C) than the air around it. Due to this temperature difference, the water will get slightly warmer until it has the same new temperature as the air.