@haikushack not exactly. You can follow, reply, and favorite other people on other servers, but your account can't "join" them. Think of it like email. A @hotmail address can email a @yahoo address, but you cannot log into Yahoo with a Hotmail account.
All servers that your server knows about (from people following or interaction) is collected in the "Federated/Public feed".