You can spray pyrethrins in the individual holes and then after the application dries dust each of the hoels with Drione dust (the Drione dust will not work when wet). Below is the usual recommendations for cicada killer wasps:
Cicada Killer wasps thrive in disturbed environments, such as landscaped yards and places where bare soil is exposed. You can discourage the wasps from nesting in your yard by cutting your grass on the highest setting and by adding a thick layer of mulch to flower beds during the Cicada Killer Wasp season. These wasps do not like over saturated lawns either, so over watering during their season will help prevent them. Unfortunately, there is no fool proof way to prevent cicada killer wasps. For current infestations, you would need to use Drione in each individual burrow.
We also like to let our customers know that the Cicada Killer wasps are beneficial insects that provide free pest control for a couple months each year. Cicada killer wasps paralyze and provision their burrows with other insects to feed their young. The beneficial Cicada killer wasps, while large and intimidating to see, are mostly harmless and there have been very few reports of anyone getting stung by just being near them. In most cases where a sting was reported, the wasps were being held or molested in some way.
Drione dust is labeled for outdoor flea control in lawns. The Drione dust product label (bottom of pg 2) recommends that you use 16 oz per 1,000 sq ft. This type of application can get very expensive and can be washed away when it rains. We recommend you purchase and use our Outdoor Flea Kit which comes with an insecticide to eliminate the jumping biting adults and an Insect Growth regulator to stop the growth cycle of the immature fleas.