Adventure,
I can hear the pain and sadness in your post.
I was like you except I was at my 10 year anniversary and 4 weeks after that, I made him leave.
6 years previously a good friend of mine asked me where I though I would be in 5 years time...I replied " probably in the same place" and I was.
I felt ALL those things you mentioned, fear & Guilt especially....but I didn't want to spend another 5 years wishing I had made a different choice.
Be gentle with yourself....what you are contimplating is a huge decision.
Sending you positive thoughts and BIG HUGS
M.