The correct option is
C 1abtan−1(atanxb)+c∫dxa2sin2x+b2cos2x
Dividing numerator and denominator by cos2x
=∫dxcos2x(a2tan2x+b2)
=∫sec2x.dxa2tan2x+b2
Let
tanx=t ⇒sec2x.dx=dt
Then,
∫dta2t2+b2=1b2∫dta2t2b2+1
=1b2∫dt(atb)2+1
=1b2batan−1(atb)+c
=1abtan−1(atb)+c
=1abtan−1(atanxb)+c