Agreed, drying fans is the best way, collection for processing into extract, get it dry, and keep it cool, then protected against any future moisture.
If you got something that's questionable, and you don't want to toss it, dry/keep it separate, don't mix any bad (remotely moldy) stuff into your dry bin.
This is in another vein, but still applies: If you've got a big huge cola with some bud rot, I generally cut off, discard anything remotely rotten, then I take the entire cola, and keep it separated from anything else, to ensure not a single spore is transferred into my fresh clean flowers.
The real key here is segregating the good, the bad, and the ugly. As you continue to grow, lots of things end up in that fan leaf bin. I try and set a standard of sorts.. When your dealing with outside, some things are obviously unavoidable, so using good "clean technique" becomes even more critical.