Thanks to everyone for commenting. It's highly appreciated.
Some counselors of mine have said it was due to anxiety, but I had been in their care for anxiety, so everything was easily lumped together as such. In fact, every potential 'medical' problem was supposed to be solvable with meditation, and CBT. What a joke.
One thing I've noticed about this mild vertigo is that is seemingly doesn't happen when I'm away from home. I'm thinking about going to a doctor about this, but the bouts are so random that I have no idea what's causing them, or when they'll even happen.
There seems to be a link between this and IBS, so maybe that's it. Or I'll never know.