I'd say the Baths is a must see once. Once you've seen it, you've seen it, but I do think it is worth seeing.

There are plenty of things to see and do if you don't go there, such as JVD, the Indians, Caves..etc.

Matt