Countless times I have done this. Biggest problem tends to be insects brought in with the plants into a unnatural environment with no predators other than you and whatever is in your arsenal for insects. The plants will take the transition a lot better going indoors then in reverse where hardening of the plants is mandatory.