If we have two servers, so if we want to connect server A to server B, the private key should be on server A, and server B should have the
public key.
Public key, that is, is written in an authorised file, and the private key is put in the SSH files...