Readerbaby...this is how I interpreted your post.
"I'm putting a lot of trust in my BF, "
Doesn't sound like trust...seems like control and expectations.
"I don't want to have to ask you over and over again because it makes me feel weird."
"Maybe I didn't say it in the best way, but I wanted to make it clear what I expect and when. He got irritated with me and told me to stop worrying and that everything would be fine. I do realize that I am projecting my own fears about not having money, but I also wanted to hash out exactly what we agreed upon."
Maybe starting this conversating by acknowledging that you have fears and voiceing thise fears to him. Then asking to revisit the terms of your agreement because of your insecurities. Useing a tone and laungage in a non judgemental way, may have come off as less accusatory, attacking to him? This is your project and and you chose him as your partner? If you didnt pick a good one, thats not his problem....
Good luck with your life change!