The correct option is
D 1−x4f(x)f(1x)=f(x)+f(1x)
⇒ f(x)f(1x)−f(x)=f(1x)
⇒ f(x)=f(1/x)f(1/x)−1 (i)
Also, f(x)f(1x)=f(x)+f(1x)
⇒ f(x)f(1x)−f(1x)=f(x)
⇒ f(1x)=f(x)f(x)−1 (ii)
On multiplying Eqs. (i) and (ii), we get,
f(x)f(1x)=f(1/x)f(x){f(1/x)−1}{f(x)−1}
⇒ (f(1x)−1)(f(x)−1)=1 (iii)
Since, f(x) is polynomial function, so (f(x)−1) and f(1x)−1 are reciprocals of each other. Also, x and 1x are reciprocals of each other.
Thus, Eq. (iii) can hold only when
f(x)−1=±xn, where n∈R
∴ f(x)=±xn+1 but f(3)=−80
⇒ ±3n+1=−80 ⇒ 3n=81
⇒ 3n=34 (∵3n>0)
⇒ n=4
So, f(x)=−x4+1