Sure, we all know that it's not cheating if it's not intercourse.
I could be wrong, but the way he said it, and the tone he used were exactly on point for his "I want to hurt you mode". Had he done it, he would've shut up about it and try to make me think I was crazy for having suspicions.
At this point, I don't care if he did do it or not. He cross a boundary he shouldn't have. What little trust there was left has gone bye-bye!