Tasks can be deleted from the My Day screen. To delete a Task, Right Click on the Task itself and choose delete.,
