I'll only signal left if there's a car waiting to turn out of the minor road or I'm confident of the intentions of cars around me and my ability to comfortably avoid them. Sometimes in the same situation as the OP that'll involve me politely telling the van to go first.