Our most popular dust for bees/wasp is Tempo Dust. You will need a hand duster to apply it with. It usually works within 24 to 48 hours. You want to go up to the opening where they are flying in and out of at dusk or at night when they are not active and puff twice directly into the hole. Then pull the duster out and puff directly at the hole to cover the opening from about 5 inches away. This is the most efficient and fastest way to eliminate a bee/yellow jacket/wasp nest.
Tempo dust would be a good choice to help control the cicada killers. Tempo dust offers a pretty fast knockdown though you should note that it does not offer an instant knockdown. You may want to consider using a instant knockdown spray such as Eco PCO Jet-X. Eco PCO Jet-X provides instant knockdown and kill of stinging insects. The Jet Spray can be sprayed up to 15 ft. Cicada Killer wasps thrive in disturbed environments, such as landscaped yards and places where bare soil is exposed. You can discourage the wasps from nesting in your yard by cutting your grass on the highest setting and by adding a thick layer of mulch to flower beds during the Cicada Killer Wasp season. These wasps do not like over saturated lawns either, so over watering during their season will help prevent them. Unfortunately there is no fool proof way to prevent cicada killer wasps.