I don't think you can make the CF card the default for installations, but you can definitely install software there. If the setup file is a .exe, then there is a point in the installation when it asks you if you want to install it to the default location. Say no and select your CF card. If the software you're installing is a .cab file, then you'll need
CabInstl. It'll let you install .cab files to wherever you want.