Just my 2 cents - we did this once and our second time flew into Key west. It was much better that way. If there's an accident or any kind of traffic, the drive can take a long time. However, we were there for a shorter visit so given a longer trip it might not be a big deal.

If you are planning on making stops along the way, it could be nice, but otherwise not worth it in my opinion.