In the Appointment or Task set the reminder option. I believe it is off by default. I noticed that when you create a task, you can't set the reminder unless you move the occurs option around. After that, the reminder option is changable.
For calendars to remind you, there should be that option on the bottom when your entering a new item in the calendar. Look for "reminder". it should also be the same thing for tasks.