When an electromagnetic wave strikes the surface of a metal, at microscopic level, atoms of a metal absorb the photon and its momentum is transferred mainly to the nucleus and electrons.
The excited electrons emit approximately opposite to the direction of photons.
Conservation of momentum needs to be accounted for the momentum transferred to the nucleus and electrons.