If I were you I would let his PO know. Yes it will be 'he said she said' but the PO has the option of putting an 'ankle monitor' on him and then if he chooses to violate his parole he will for sure be caught and I would not have my sleep disturbed by his 'comings and goings'.
J M H O
Love and hugs,