Just picked this up off the beta newsgroups. My buddy Mike Kolitz posted this a while back, and it still works. You can install the WHS Connector software on a Vista x64 machine my running the following command in an elevated command prompt.
msiexec /i \\SERVER\Software\Home Server Connector Software\whsconnector.msi WHSMSI="RUNSETUP"
It will install just fine, but backups won't work. Just shut them off for that machine in the console once it's up and running. It still won't solve your backup issue, but if you're running a pure 64-bit environment like I am, you'll be able to manage your WHS without remoting into it.
Thanks to Janson Ragon for the tip.