You know things now you didn't know before and you are far more self-aware. I am in no way taking a position on this, but your story is one I share with a woman who is not my RAW. She's married with children, but if we ever had the opportunity without destroying our families I'd see it through with her. The attraction between us remains strong, and was in fact growing, so we mutually agreed to no-contact two years ago (we've kept track of one another for 31 years).
There are no guarantees in life, but I'm no longer going to watch the doors of opportunity open without going through them. If we are ever both single I'm going there immediately.
My two cents.
Cyranoak