What I've previously understood, and had confirmed from this thread, is that small sea shells and sea glass are not a problem.

However, Conch shells are a problem if SXM Security or US Customs becomes aware of them. They will be seized, based on CITES.