The added immersion and realism goes a long way, probably a lot more than you might think.
Open Cities Skyrim is a comprehensive project that aims to bring back at least part of the feel of Morrowind - specifically how most of the cities were a natural part of the world and you could just walk in without loading screens.