There are two extremes going on in your mind in relation to this issue.
It's what we do not what we think that impacts us most in "real" life, outside our head.
It sounds like you want affection and intimacy but your self esteem has taken a battering and you fear no one will want you.
Be kind to yourself - in time things can get better if you work it.
Hang in there