Plastics seem to be OK for short-term use, but I've mostly stopped using them due to concerns about chemicals they leach.
I agree with the suggestion for clay (plain orange terra cotta) pots. They are safe and have a nice porous texture that provides a good surface for growth of beneficial bacteria and algae. Plastic plants are OK, but I'd be very careful about ones that aren't made for aquariums.