Any other big buds you have I would start looking on the inside now by spreading them apart . Shake off the late season rain if the temps are lower. Egg shells is what I use to prevent it.
The egg shells goes in the soil btw. The worm is most likely a caterpillar. They eat and shit in your plants leaving bud rot. Inspect your plants thoroughly.