You need an application to edit the registry. I use PHM Tools to do it.
http://www.pocketpcfreewares.com/en/index.php?soft=31
After you've uninstalled the program (via Settings -> Remove Programs), to into the registry and search for the name of the program. Delete all instances of it. Too bad you have to do it manually though.