Your crop won't get destroyed at that stage. First, late flower nanners often don't even contain pollen, or very little. Also, since they are in a bud instead of hanging freely like on a male little of any pollen gets anywhere except the spot where the nanners are. Additionally, it takes days to a week for the nanners to mature and pop 'dry' pollen, and then it takes days to a week more before the seeds start to develop.Last but not least, if you are already looking at trics I assume there aren't a whole lot of white pistils left. White is alive. Only when alive they can get pollinated.
Unless you are running a 12-16 week sativa or something it's unlikely to "destroy" your crop. If it's just a few plants/buds, just remove them (the nanners). If they are done in a week you could let them go and remove them while drying/trimming. If it's like one small area in a large grow space you could treat it like rot, as in cut out the bad parts.
Good luck.