You refer to him as 'recovering' but it doesn't actually sound like there is any recovery work going on, just a dry drunk with lots of days off from sobriety.
If he doesn't want to change then no one (including you) will be able to force him to do so. Perhaps you could ensure that those visits are supervised as agreed, and if ever in any doubt as to his drinking then insist on a breathalyser before handing your child over. Your childs safety is of most importance now - and that means emotional as well as physical safety. If you are in any doubt of the affects of an alcoholic parent on children then a skim read of the ACOA handbook will be very informative, or a quick browse in the Adult children of alcoholics area on this forum.
Please remember that you are not responsible for him or his alcoholism, and you can still care about him and be reasonable without that standing in the way of protecting your children. Sure, he might not like it, but that's not massively important. There are plenty of options available to him if he really wanted to work on his recovery, and he's a grown adult.
Wishing you all the best. BB