Smell is a sensation perceived by our sense organ nose to recognize fragrance caused by aromatized molecules of perfume in the air, therefore, smell is not matter, it is a sensation, whereas the molecule of perfume with which it is associated is matter.
Likewise taste cannot be categorised under matter.