I really wasn't trying to minimize- His actions indicate he for some reason doesn't trust you, and with limited background info one can only speculate as to why. I don't know either of your stories, and was merely throwing out some ideas for what appears to be irrational behavior on his part. Not sure it has anything to do with gender.
As part of my inquisitive nature, I am still wondering how you know the background check was for you?