The correct option is D −x2xtanx+1+2log|xsinx+cosx|+c
I=∫x2(xsec2x+tanx)(xtanx+1)2dx
Put xtanx+1=t⇒(xsec2x+tanx)dx=dt
∫(xsec2x+tanx)(xtanx+1)2dx=∫dtt2=−1t=−1xtanx+1
Now, using integration by parts
⇒I=x2∫(xsec2x+tanx)(xtanx+1)2dx−∫2x(∫(xsec2x+tanx)(xtanx+1)2dx)dx
⇒I=x2(−1xtanx+1)+∫2xxtanx+1dx⇒I=x2(−1xtanx+1)+∫2xcosxxsinx+cosxdx
Put xsinx+cosx=z⇒xcosx dx=dz
⇒I=(−x2xtanx+1)+2log|xsinx+cosx|+c