There’s no difference between scaling the graphics and running at a lower screen resolution so that it fits the entire screen, so I can’t see what you’re worrying about.
If your graphics look rubbish scaled up, then they look rubbish already! If scaled up, at least there’s the opportunity that you might use an intelligent scaling that makes them look more attractive…
Also, why on earth would it slow things down?