Personally, I don't think you're missing much with not using the pool at Scrub. We stayed here 2 days pre-charter in April. With the beautiful waters of the BVI's, I'd rather be in the ocean than the pool. Poolside drink service was non-existent so IMO you're better off swimming off the back of your boat & making your own cocktails :-)
As for Anegada, if snorkeling is not important, I'd go with Cow Wreck any day. Totally laid back, beautiful waters, great cocktails and Ann's smiling face. :-)