I have exactly the same problem. Been pulling my hair out for the last three days trying to fix it.
Not only can none of the VCA's talk to it, the local VCA running on the VCRM server can't talk to it locally even with localhost.
I have tried configuring via Certificate and Login, neither work.
Looks to me like VCRM 7.3 is fundementally broken.