Do you think it's possible that the way he's sees it, is that he has lost one parent by way of addiction, and he's just feeling some sort of insecureness when you're not around?
(that seemed like alot of words to say that...LOL)
Maybe he just needs some time, and reassuring that you're not going anywhere.
Hugs to you,
Kids, they're tough to figure out sometimes...