Hi Tosha, this article has a few suggestions you could try to get rid of water bugs - https://home.howstuffworks.com/how-to-get-rid-of-water-bugs.htm
Spray with roach spray.
How to Get Rid of Water Bugs
Hi Tosah: Take a peek at these sites and see if anything works for you:
Call a professional in for a free estimate, then do what he suggests and buy an appropriate insecticide and apply it as the directions state. Sanitation and no damp spots are also important. If you are in an attached dwelling, the job becomes infinitely more difficult if your neighbors do not cooperate.