Welcome to the forums!
On the H2210, you won't have to worry about operating systems ... it only comes with Windows Mobile 2003. It's an older model, so make sure you're not confusing it with the newer hx2XXX models (like the hx2415, hx2755, etc). They run on Windows Mobile 2003SE and can be upgraded to Windows Mobile 5 (and some can be bought with it already pre-installed).
One thing to majorly consider with the H2210 is whether or not you need WiFi, as this unit does not come with it built-in. Since it's one of the only older models with two expansion slots (CF card and SD card), you can always buy an add-on card for WiFi, but generally you're better off with built-in support if you plan on using it a lot.
For navigation, do you mean GPS? The H2210 does have bluetooth support, so you can always use a bluetooth GPS receiver and keep your CF card slot free for memory or other add-ons, which is nice.
Music can be listened to using TCPMP (a freeware program), which can also play many (and I do mean MANY) types of movies and codecs (avi, mpg, divx, xvid, etc).
I believe WM2003 comes bundled with an HP Photo viewer program. There's plenty of good ones out there to download, too. A good place to check out software is
www.pocketpcmag.com. Just look at their Best of 2005 awards list for Pocket PC programs.
What kind of budget are you looking at? The H2210 is a great little player, but I think there's better that can be had for the money with as old as it is depending on what you're planning on spending.
Again, welcome to the forums!