The correct option is
B 8L/15For the system to remain stationary and un-toppled, the moments due to weights must be balanced with the normal reaction.
But, the normal reaction location is limited by the edge of the table.
Part 1 : Stability of the Upper block and Sphere
Let the length of the upper block, beyond the lower block be y.
The normal force exerted by the lower block on the upper block is 3Mg2
The farthest distance possible is when normal reaction acts at the edge.
Moment balance about the edge of the lower block gives Mg2y=Mg(L2−y)
∴y=L3
Part 2 : Stability of Upper masses and lower block
For the farthest distance possible without toppling, normal reaction acts on the edge of the table.
Normal reaction exerted by the table is Mg+Mg+0.5Mg=2.5Mg
Fixing origin at the edge of the table,
Location of CG of lower block is x−y−0.5L
Location of CG of upper block is x−0.5L
Location of CG of sphere is x
Applying moment balance about the edge of the table, we have
Mg(x−y−0.5L)+Mg(x−0.5L)+0.5Mg(x)=0⟺5x=2(L+y)=8L3
∴x=8L15