Welcome to Aximsite!
What you're describing has nothing to do with WMP itself, but the fact that tapping on the X at the top only minimizes but does not close programs. That's why lots of people use 3rd party utiltiies such as
Magic Button, which is freeware.
As for your device searching for audio/video files each time you insert a memory card, that's normal. :)