The correct option is B ±(j−k√2)
Let the vector be given as aj+bj+ck. For this vector to be coplanar with i+j+2k and i+2j+k we will have ai+bj+ck=p(i+j+2k)+r(i+2j+k) this gives
a=p+r....(i)
b=p+2r....(ii)
c=2p+r.....(iii)
For the vector ai+bj+ck to be perpendicular to i+j+k we will have
(ai+bj+ck).(i+j+k)=0
⇒ a+b+c=0.....(iv)
On adding Eqs.(i), (ii), (iii) we get
4p+4r=a+b+c
⇒ 4(p+r)=0
⇒ p=−r
Now with the help of Eqs (i), (ii) and (iii) we get
a=0,b=r,c=p=−r
Hence the required vector is r(j−k)
For unit vector, r2+r2=1
⇒r=±1√2
Hence the required unit vector is ±1√2(j−k)