Answering the original question: Yes, you can indeed paddle a kayak to the conch shell mound from the fishermen's landing in the village. I have paddled that trip several times - not to visit the mound, but to fly fish for bonefish on the east end.
If the wind is not strong, it is not a difficult trip. Stay in near the mangroves as you go and you will find am opening that takes you into a set of channels back into the mangroves. There you will see one of the beautiful spots on Anegada that few people experience - the channels are an estuary with clear water where you can see lots of fish.
On the other hand, it the wind is strong enough for white caps, the paddle eastward is a struggle.
Forget the notion of continuing around to Big Bamboo. That is a no-go.
.
