Any "hassle or unpredictability" of the ferries can easily be avoided by chartering in the USVI in St Thomas. The St John National Park offers a number of anchorages/moorings that are very quiet and natural with no commercial facilities ashore. It is an easy sail to the BVI as the 2 Island Countries are only separated by a very short distance. It can be a wonderful combo and best of both worlds.
There are quiet places in the BVI, November, except for the American Thanksgiving week, is generally not seasonally busy, and the St John anchorages are much less visited that month as well.