If you get away from the hubbub of downtown Key West it's quite pleasant, although still very touristy. I prefer other parts of the Keys myself. We spent a couple of days a the Southernmost Motel about a decade ago, and enjoyed walking around the residential parts of town, hardly ventured uptown at all. Sloppy Joe's is terribly commercial, as I'm sure everybody knows.
So maybe I'll spend the day at Chankanaab after all.