The correct option is C a=2,b=32
x2−3x+a=0
For this to be true, roots have to be real or b2−4ac≥0⟹9−4a≥0ora≥9/4⟹a≥2
So, a=2. The roots x2−3x+a=0 of are 1,2.
x2−12x+b=0b2−4ac≥0⟹144−4b≥0orb≥36
But, given the roots of both equations are in increasing GP. Hence, b must be 32.
The roots of x2−12x+b=0 are 4,8.
Now, we can say all the 4 roots are 1,2,4,8 which are in increasing GP.
Therefore, ′a′=2 and ′b′=32.