It is illegal under federal law for him to possess a firearm. My own suggestion is that you call the police and ask them to remove the guns for safekeeping. Have them send the receipt to his lawyer so he knows where they are.
Since they are in your house, I doubt that he will wind up being charged with any crime, but they need to be removed for your own safety, as well as compliance with the law.