Team Foundation Source Control and Visual Studio 2003 now works
Using the latest release, I now got it up and running. (Opposed to the crash I got with the previous version)
See a small review I did with screenshots and the download location in this article.
So this is the point where we can really start saying goodbye to Visual Source Safe 🙂 and migrate all sources we need to maintain in Visual Studio 2003 to Team Foundation Server.