The correct option is D 5π6
The given equation is
cotx=−√3
⇒x=cot−1(−√3)=cot−1(cot(−π6))
We know that, the range of the principal value of cot−1x is (0,π)
Therefore, x∈(0,π).
∴x=π−π6=5π6∈(0,π) and cot(π−π6)=−cotπ6=−√3
Hence, principal solution of the equation cotx=−√3 is 5π6.
Therefore, the correct answer from the given alternatives is (c) 5π6.