You probably want low-growing plants and shrubs that will secure the soil to prevent erosion. Here are a few suggestions for your area and conditions:
Bush cinquefoil (Potentilla fruticosa)
Butterfly weed (Asclepias tuberosa)
Physostegia virginiana (Obedient plant)
Oxeye daisy (Leucanthemum vulgare)
Euonymus alatas (Winged eunonymous)
In addition, check with your local county extension service for clumping, ornamental grasses that thrive there.