If you dont use any kind of fertilisation then growig media seems to be charged with a lot of Nitrogen, which negatively affected bud swell.
That's why more advanced growers use medium free of nutrients promix,coco or build their own soil.With that you have all control over fertilisation.
Keep that in mind for next grow.