Before a partnership deletion you'll be given the option to save folders if you do it through Activesync up to version 3.8 anyway. I haven't had to do it yet with AS v4.1 yet. ;)
You probably could manually delete everything with a PC file explorer but that's wayyy to much werk! for me.