Bugs definitely have preferences and each strain has a different level of vulnerability to outside environmental impacts.
Not all caterpillars Turn out to be bud eaters either, been dealing with this same issue for over 6 months and I’m freaking over it. Whatever larvae it is likes the stem and nodes (it’s not a stem borer though these are like under the first layer) and they are super tiny