I can't think of a reason you would need your wallet kept anywhere when walking to/on an isolated beach. EVERYTHING I take is stuff that would not be an issue if I didn't have it for the ride back to the resort.

I should add, since Happy Bay was mentioned, We have been going over that hill to the beach for many years and never have had an issue with anyone....not saying I am lax...just relaying my experiences