Wait until the fall when plants have died back. Then, remove spent flowers, dead leaves, and stems. If they’re still green, they are feeding their roots and need to keep going.