The correct option is C xe−2x
d2ydx2+pdydx+qy=0 ... (1)
It auxiliary equation is
m2+pm+q=0 .... (2)
Since, its solution is given as
y=c1e−x+c2e−3x
⇒m=−1,−3
Hence from equation (2),
(−1)2+p(−1)+q=0
p−q=1 .... (3)
and (−3)2+p(−3)+q=0
3p−q=9 ... (4)
Solving (3) and (4), we get
p=4
q=3
∵d2ydx2+pdydx+(q+1)y=0
Putting the value of p and q, we get
d2ydx2+4dydx+4y=0
∴ Its auxiliary equation is
(m2+4m+4)=0
m=−2,−2
y=(c1+c2x)e−2x
∴ Its solution is xe−2x