go over to the Nyhavn district. There are canal boat rides and lots of interesting cafes.
There is a tiny shopping center right at the port. The main shopping thoroughfare in Copenhagen is not too far from Nyhavn.
The little mermaid is right near the entrance to the port, but that's about a 5 minute stop.
We very much enjoyed seeing Tivoli Garden, especially at night. That's also either a decent walk or a taxi ride from the port.
Enjoy! Anne