Good coffee shop at Top of the Baths now. We liked spending time at Spring Bay and then running up to Mag Dogs for lunch and bringing frozen coffee back with us.
You should be able to connect with a taxi no problem. You could also think about renting a car for a day. More freedom!