I don't think leaving the cherries out would be a problem. If you do that, let me know how it works.