For additional protection your authorized_keys file can be put in place to only acknowledge connections from specified IP addresses or hostnames. Placing that up is over and above the scope of the information, but more details within the SSH authorized_keys file can be found at SSH Academy: Configuring authorized_keys https://createssh.org/