What happens when you try to remove it via AS or Remove Programs? Does it do anything at all? Does it leave parts behind? Did you try a soft reset before uninstalling?
Also, there are some utilities that might help with removing programs such as SKTools. Give the demo a try. Be sure to do a backup first though.
SKTools features
The other thing to try is to try reinstalling the drivers, then uninstalling them. Perhaps there was some corruption in your original installation.