Experts and BHG readers answer.
Black ants in plant pots
It's more likely that the ants are feeding on aphids that may be present. Are the leaves of the plants sticky with "honeydew" secreted by aphids? If so, use insecticidal soap on the aphids and that may solve your ant problem. If not, treat the soil itself with carbaryl (Sevin) insecticide.