It's almost ALWAYS a good idea to lawyer up. Too much at stake here not to. Hopefully, if nothing else, your experience so far has made you a bit more confident that professionals can see through his BS. I'd minimize contact with his family, too. Don't discuss anything but the baby. Tell his mom you don't want to talk about what he and his dad are saying/doing. It truly won't help you--even though it might seem useful to know what they are thinking/saying, just assume it's not going to be good or generous toward you and you'll be on the right track.