It does seem a little selfish on his part, but maybe there are friends he wants to see again that he only gets to see at this annual event. Hard to tell without knowing more details. If you feel you're always fighting for his affection then maybe there are some bigger relationship issues there, but I suggest giving it more time and sobriety before you try to sort them out.