We're pretty well surrounded by wasps here, with nests all around, and usually let them be unless they are nesting right by a doorway or on some project we're working on. The way we usually get rid of them is to go out early in the morning before they become active (it helps if the weather is cool), and knock the nest down with a stick. They will usually go away if you destroy their nest (but of course this means killing any young who are in there). If the nest can be dislodged into a box or something, and moved away, they MAY (but unlikely) be able to find it again and continue raising the young.