The best time to add compost to a perennial garden is before you plant anything in the garden. This allows you to work the compost into the soil where it does some good. You can also add compost when you divide or transplant your perennials. Work some into each planting hole. You can spread a thin layer of compost over the entire garden in late fall.