Do NOT hit him, no matter what. YOU could be the one who winds up in jail, which may be what would make him happier than anything, or he has an "excuse" to beat the hell out of you.
Being fearless includes being SMART. So assume nothing, just work on making your exit as quickly and safely as possible.