Yeah, I'd take my profile down for a long while if I were you. Maybe you can put it back up over the summer.
I would not look at this as uber creepy - it's just childish. This is what Jr. high aged kids do to each other. It's just yet another sign of seriously stunted emotional growth on his part. Take it down and hopefully he'll get distracted by a shiny object and wander away.
Meantime be aware of your surroundings especially when parking by your home at night. Maybe get a little something for peace of mind like an airhorn or pepper spray. Just in case.