The correct option is A −144
(1−x−x2+x3)6
=(1−x)6(1−x2)6
=(6∑r=06Cr(−1)6−rx6−r)(6∑s=06Cs(−1)6−sx12−2s)
For x7 term, the possible combinations are
r=1, s=5
r=3, s=4
r=5, s=3
Hence, coefficient of x7 is
6C1(−1)6−1⋅6C5(−1)6−5+6C3(−1)6−3⋅6C4(−1)6−4 +6C5(−1)6−5⋅6C3(−1)6−3
=(−6)(−6)+(−20)(15)+(−6)(−20)
=−144
Alternatively, (1−x)6(1−x2)6
=(1−6x+15x2−20x3+15x4−6x5+x6)(1−6x2+15x4−20x6+15x8−6x10+x12)
∴ Coefficient of x7 is (−6)(−20)+(−20)(15)+(−6)(−6)
=−144