Yes ,a conductor get charged while rubbing but the conductors could not hold charge an they rapidly transfer that charge to other body. Suppose we rub a plastic scale and a copper scale holding in hand and bring them near pieces of paper .the plastic scale will attract the papes but copper scale will not. The reason behind that plastic is not a good conductor so the charge on it get accumulated on it, but coper is a good conductor so it will transfer the charge to our body via hand. So it will not attract the pieces of paper.