I am not sure this guy is a bozo though he may well be. Dandylion is right, if you are dating a guy and don't want to sleep with him then, please, do not go back to his house at the end of a date. Anyone can talk all they want about respecting boundaries but the fact is that many men will assume that sex is somewhat on cards and make a play for it. So don't put yourself in that position.
Once he made his intentions clear and you did not want sex you could have just left saying you would call him tomorrow. Instead you muddied the waters more by staying and drinking and then getting drunk. I wonder what his version of events sounds like? You may or may not be meeting the right guys but you are certainly not dating safe and smart. Just my opinion