The correct option is B 8:3
Let the coordinates of vertices O,P,Q,R be (0,0),(a,0),(a,a),(0,a), respectively.
Area of the square is a2
Coordinates of M are (a,a2) and those of N are (a2,a).
Therefore, area of ΔOMN
=12∣∣
∣
∣
∣∣001aa21a2a1∣∣
∣
∣
∣∣
=3a28
Hence, the required ratio is 8:3.