You are correct about where the aquarium is and I would NEVER try to swim there. I almost hit a lady out there last year while dingying from the baths to VGY Harbor... it shocked me to see someone swimming out that far without a boat or a dingy. Everyone enjoy! But mostly, be safe.