You not only did the right thing, you did the only thing that could be done.
As you mentioned, if drugs were found there and you had given him permission to be there, that would make you an accessory.
Get a protective order and tell the police that you need to be notifed when he is released. Better yet, have a lawyer do it.
We don't have to be responsible for them, nor should we have to be afraid.
Protect yourself from him and then be glad he is gone.
Hugs