Find the maximum mass m2 that can be hanged from the pulley such that the system remains in equilibrium. Coefficient of friction between block m1 & wedge is mu.
m2=m1(sinθ+μcosθ)
So maximum mass is asked that means if I increase the mass even a little the system should start moving. So if I increase m2 little bit more than maximum, then m2 block will go down and m1 will have a tendency to slide up the block so friction on block m1 will be maximum and in downward direction.
Lets draw free body diagram of equilibrium condition
T=m2g
N=m1gcosθ ..........(i)
fr=μN=μm1gcosθ
T=m1gsinθ+μm1gcosθ ........(ii)
solving (i) & (ii)
m2g=m1gsinθ+μm1gcosθ
m2=m1(sinθ+μcosθ)