Bugs are a fact of life outside, I preventative spray to keep from getting a full blown infestation, and plant herbs and stuff that they don't like. Aphids are the worst because they're almost impossible to get rid of completely, they get in all the nooks and crannies... easier to deter them from setting up shop than to evict them. I do neem a couple times in veg, then alternate
lost coast plant therapy for aphids and PM and Monterey BT for caterpillars, grasshoppers and other munchers, once in flower I try to avoid the buds as much as possible and cut back to like once a week sprays and no longer use neem. I wash my harvest as well.... but yeah, there's a ton of microscopic pests than can cause various issues. Some bugs carry bacteria or fungi that can infect the plant, some bugs are beneficial cause they eat the bad bugs, same with microorganisms in the soil... it's a whole song and dance lol.