I have not had trouble with either. One thing I would suggest with either is elevating the pot off the ground, you really do not need much, just an inch will help with the roots getting better drainage and more oxygen to the roots. Just my two cents. Also with the plastic pots consider adding perlite to the bottom for better drainage. Just like an inch or two does it for my stuff.
ive only used fabric but it seems to me the runoff would be easier to handle with plastic. especially if you drill your own holes into a plastic bucket on the inside of the lip. the water tends to run down the sides and drip a bit oddly once it gets to the bottom with fabric. at least in the 4 plants i've grown. more control in the plastic i'd imagine.