If I do (or, more importantly, if my wife (who is not into shifting for herself (pardon the pun)), then the transmission is no longer "automatic" then, is it?
The low shift points seem to be more of an irritant when operating at low highway speeds. Fifth gear can enter lugging territory whenever more than a minor hill is encountered, as others have noted, but the transmission wants to stay in that high gear in the worst way.
With everything under the Smart sun apparently under computer control, it would seem that this issue too would be "configureable". It's not a deal killer, but it is a minor irritant.
One thing about the Smart that is pretty neat is that you can use the manual shifting option either from the steering wheel paddles or from the floor mounted shift lever. (Our Scion xB only offers this from the floor mount.) However, the location of the floor lever isn't very convenient if you have an arm rest installed and in use.