Phosphorous exist as P4 which is a very strained molecule and thus it is very reactive also. It reacts with oxygen present in air and may ignite. Hence, it is kept in water to avoid its contact with air. It remain insoluble in water. However it is not kept in kerosene , oil , benzene etc because it is soluble in these solvents. Therefore can not be stored.