The correct option is D None of the above
Let the third charge −q is placed at a distance of x from the charge 2 q. Then potential energy of the system is
U=k[(2 q)(8 q)r−(2 q)(q)x−(8 q)(q)r−x]
Here, k=14πϵ0
U is minimum, where
2x+8r−x is maximum.
Let 2x+8r−x=y
For y to be maximum dydx=0
or −2x2+8(r−x)2=0
or xr−x=√28=12
or x=r3
But at x=r3,d2ydx2= positive
i.e., at x=r3, y is minimum or U is maximum. So, there can't be any point between them where potential energy is minimum.