Hi, ChatKatR. Assuming you enjoyed S&W and the Four Seasons, I have some recommendations in the "neighborhood" of the Waldorf.
Just down 49th, steaks at the Prime Grill (they also do sushi but haven't had it). Wonderful seafood at Oceana, a few blocks up on 54th. Also on 54th & 3rd, French/Thai at Vong.
Sushi Yasuda on 43rd (2nd & 3rd) is a great room with beautiful fish, artful, very special. A menu that might seem unusual but which is superb, Korean vegetarian at Hangawi on 32nd. Right across the street from Hangawi, Artisanal (32nd off Park) -- terrific cheeses and great wines-by-the-glass.