Nobody can predict what your detox experience will be like, so it really is best to have some medical advice. People have various experiences with tapering off. Mine was OK, but it seems more people have found it a problem.
If you check with your doctor he or she can take a health history, tell you whether it's safe for you to quit, advise you how to do it, and perhaps give you some short-term medication to help manage any symptoms. If you DO get scary symptoms, you should call for immediate medical help.
For lots of people detoxing is uncomfortable only--but you never know whether you might be one of the ones who has a severe reaction.