The correct option is A a=4,b=4
Since (x−2) is a factor of f(x),using factor theorem, f(2)=0.
23−a×(2)2−b×2+16=08−4a−2b+16=02a+b=12...(i)
When f(x) is divided by (x - 3), theremainder is f(3) by remainder theorem. The remainder is given tobe (-5).f(3)=−533−a×32−b×3+16=−527−9a−3b+16=−53a+b=16...(ii)
Subtracting equation (i) from equation (ii), we get:(3a+b)−(2a+b)=16−12⇒a=4
Substiuting value of a in (i), we get:2×4+b=12⇒b=4