Sunshine - they may be dodging you because they feel guilty about the way they acted. They blatantly took advantage of the situation.
If they are pissed about it then they got it twisted. It is your pool not theirs. How about some gratitude that they got to use it in the first place.
I had a terrible problem with people pleasing throughout my life until I really started my recovery. Certain people distanced themselves from me as I changed, because they saw that I wasn't going to tolerate their BS any more. At times I would feel guilty about being a 'bad guy', but that went away over time. The reality was that I wasn't being the 'bad guy'. I was sticking up for myself. It is almost second nature now. Thank God for that because it gave me time to focus on myself and find real friends.
If your neighbors want to pout about the situation it is probably a blessing in disguise. Good for you for sticking up for yourself.