Both Na and Ca react with water to form their respective hydroxides. On the other hand, Na readily reacts with alcohol to form sodium ethoxide but Ca reacts only very slowly. Thus, when Ca is used, it will react more readily with water than with alcohol.
2C2H5OH+2Na→2C2H5ONa+H2
Therefore, Ca is preferred over Na to remove the last traces of moisture from alcohol.