"Sounds like you might have climbing cutworms. They live in the soil but hide during the day in rolled up leaves, etc. They usually come out at night, so the best (and most garden-friendly) control is to go out at night with a flashlight and hand pick them.
Sounds like you have a good start, though. By removing and destroying the leaves where they hide, you're getting the cutworms too.