I like custard slices, tarts etc with vanilla essence in them and it's never been the slightest worry for me.
I understand your caution tho Admiral and I commend you for it
There is imitation vanilla essence available if you feel concerned but don't want to lose the taste
D