If the coefficient of x7 in (ax2−1bx)11 is equal to the coefficient of x−7 in (ax−1bx2)11 then ab =
-1
For the Coefficient of x7 in (ax2−1bx)11;r=22−73=153=5
∴ Coefficient of x7 is −11C5 a61b5
For the coefficient of x7 in(ax−1bx2)11;r=11+73=6 ∴ Coefficient of x−7 is 11C6a51b6
The coefficient are equal ⇒−11C5a6b5=11C6a5b6 ⇒ab=−1