I get it that you are scared, as you should be for your child. But, it does not seem like you are willing to do a whole lot about it. You can't keep doing the same thing over and over and over again and expect different results.
Something is going to have to change, and by setting boundaries that means that you stick to them which it does not sound like you do, therefore he is not going to take any threat you make seriously.