Help, I don't want to meet up with these people!!!?

Basically I'm going round my friends house tmoz, we are goin to town, but he wants to meet his druggie friends, and I don't? I've tried to say I don't wna go but...argh what do I do?