I cannot get onto the Windows VPS using RDP.

Give the server a while so that it manages to start up and configure itself. Windows boots up two times after it is created.