Ok, devil’s advocate here, looking at it from the other point of view and I don’t know all the past history (seems you may be a bit afraid of him since you want to meet in public places). Also, I’m very new here.
If you read between the lines, He may be trying to say he is still attracted to you and wants to be with you. The part about you becoming fat like your mother is just a defense mechanism (assume because you didn’t jump right in and show the same attraction back). He just wanted you to say, “you’re right I would have been better off with you”