Only gripe I've had so far, and it's tiny really, is the removal of the option to manipulate objects without taking them. I believe it was left or right bumper in Oblivion. I found this option extremely useful when decorating my home, which I havent tried yet in Skyrim.
Great game so far.