@kasdeya It's not at all. SSH gives you a pseudo terminal on the other machine, which is different to actually controlling it.

Different screen size, terminal capabilities, etc.