Hi Jane, how does he have (or claim to have) so much information about your family?
If his allegations are false and coming from an alcoholic with mental issues then I think most would consider the source. I don't think one man can destroy a family and force them into poverty. Especially a drunk.
How long were you together?