I noticed the anxiety starting to lift after about 4 days, but my nerves still felt raw. I remember driving to the store after about 6 or 7 days sober, and looking up to see a huge can of beer on a billboard right in front of my face. It felt like someone smacked me with a 2x4..... so yeah, the nerves take a while to settle down.
Just know it will get a little better with each day (be sure to get plenty of B vitamins - I take a B Complex in addition to my multi every day - we often have a deficiency and it helps a with the anxiety)