It sounds like he was completely out of it. I mean, talking about cement and scaffolding?
Whether he was aware of what he was doing or not, he's dangerous to you and your dog at this point. Scary stuff.
You have the right to get a protective order that would require HIM to leave. You should be safe in your own home.