Been told they're inappropriate to wear around the house... should I take them off then?