Silverman says one “contempt and you can problem are two of the most extremely harmful things you perform to have relationships”