Oh, you are right. So this behavior seems reasonable, but I still can't connect from another server. When trying to ssh into the VM (by using the IP of the host and default port 22), the connection does not establish,
$ ssh host_of_vm
ssh: connect to host ***.***.***.*** port 22: Connection timed ...