Hydrogen bonding is formed by elements which have very high electronegativity. Hydrogen bonding is the attraction of hydrogen between two very high electronegative atoms. The size of chlorine is larger than that of these 3 atoms mentioned N,O,F. Hence there is not a proper overlapping to form a bond.
But there are some exceptions when chlorine can also form hydrogen bonds.