Take the ferry to Watson's Bay and eat at Doyle's, a great seafood place on the water. It's reasonably priced. Kingsley's on the Woolloomooloo pier is a great place for dinner. Go before dusk and watch the flying foxes (huge fruit bats) fly away from their tree roosts in the Botanical Garden across the water.
Jim