SarahJane,

There was no one swimming in the pool, albeit if we were guest my wife would have been going back in forth for sure.
There was a lady enjoying the hot tub connected to the pool, and she was a very happy camper. We chatted briefly but we did not want to disturb her bliss.

The beautiful indoor pool, which I remember from our honeymoon, was under renovation. The pool was empty and they were redoing the ornate plaster around the room and ceiling. It was fun to watch the craftsman at work.

Highly recommend you give Fort Lewis a try. Very relaxing on a smaller scale.

Or maybe do a split week at both.
It would be like the week Rock Resorts offered in the 70s where it went from simple to over the top.
Both places very special in their own way back then.
The vacation package had a catchy name which of course I forget, but it included:
4 days at Caneel Bay in STJ and then they transferred you to Little Dix on Virgin Gorda for 3 days.