The correct option is
C 2(x2+y2+gx+fy)+c=0Let P(h,k) be the foot of perpendicular drawn from the origin to the chord AB as shown such that AB subtends a right angle at O.
Now, the equation of AB is y−k=−hk(x−h)⟹hx+ky=h2+k2.
The homogeneous equation of OA and OB can be found by homogenising each of terms of equation of the circle as
x2+y2+(2gx+2fy)(hx+kyh2+k2)+c(hx+kyh2+k2)2=0
Now, as OA and OB subtend a right angle, coefficient of x2 + coefficient of y2 = 0
Hence, we have
{1+2ghh2+k2+ch2(h2+k2)2}+{1+2fkh2+k2+ck2(h2+k2)2}=0
∴(h2+k2)2+2gh(h2+k2)+ch2+(h2+k2)2+2fk(h2+k2)+ck2=0
∴2(h2+k2)2+(2gh+2fk)(h2+k2)+c(h2+k2)=0
∴2(h2+k2)+2gh+2fk+c=0
Hence, the required answer is 2(x2+y2)+2gx+2fy+c=0.