From the information I have, it is not safe to stop Depakote suddenly, however it sounds like you have kind of decreased it slowly the last few days. The shakiness/dizziness might be from stopping it, I don't know. Everyone responds to it differently. The biggest concern is it that it can induce seizures, however this is usually for people taking Depakote for a seizure disorder.
Have you called your doctor about this? He may be able to give you some samples from the office to hold you over.