It is possible he has developed impotency, and any situation that could lead to him being mortally embarrassed is avoided. The pattern suggests he doesn't mind cuddling when/where there is no "threat" of this being discovered, but his strong avoidance of being in any situation of when/where cuddling, etc. could progress to "more" and his mortifying situation being discovered, and his shame uncovered.
Just one "take" on the set of circumstances. This may or may not be the case, but it's one possible explanation, for the pattern.
CLMI