I personally would not feel safe at Windward anymore. Others may have more fortitude. Emerald is certainly not luxury but I have never felt unsafe. From there, you can taxi to dinner-restaurants in Frenchtown are very close.

I am sure nostalgia is pulling you back to Cane Garden Bay and I get that. Just be prepared that a lot is going to be different and you might end up asking yourself why you traversed back and forth over the island that last day when you are already looking at a long travel day home.
Again, I get why you are all in on CGB but you could save yourself money and hassle and just stay at Marias on the last night and be on the 10AM outta there. Nice leisurely wake up/breakfast and easy to get that Roadtown ferry. I have also found that after a long vacation of being on beaches and near the water, after packing up and essentially "ending" a vacation my kids are usually about beached-out.

Can you add Cane Garden Bay to your cruising itinerary?