The correct option is A BTAB is symmetric matrix if and only if A is symmetric
We are asked about whether the expression (BTAB)T is symmetric or skew symmetric uncer various conditions.
So let us start by considering the transpose of the expression.
(BTAB)T=BTAT(BT)T=BTATB
i.e, (BTAB)T=BTATB------------------(1)
case 1: A is symmetric .
(BTAB)T=BTAB
This implies that the given expression is symmetric
case 2: B is skew-symmetric .
(BTAB)T=BTATB=(−B)ATB≠−BTAB
∴BTAB is not skew symmetric if B is skew symmetric
You can similarly verify that the other two cases are doesn't lead to a right option.