Anchoring overnight would probably be ok but they wouldn't want you to go ashore on PSV.

Why not do it properly? Union, PSV and Carriacou are so close together it isn't difficult to spend the night in PSV, then a quick sail or motor to Union and then on to Carriacou.