Circle of Care/Care Team updates

We have CCMR activated and have found a bit of a SNAFU that I am hoping someone can help me with. During the enrollment process of the patient into a Care Plan in CCMR, we select the providers/users that are part of the patient’s Care Team. Once this Care Team is established, it shows up in the Circle of Care area in Demographics (surprise!).
Our issue is we are not able to update a Care Team if the Care Plan has been closed. This doesn’t seem like a big deal until a provider/care manager leaves our practice . . . . and continually shows up on our After Visit Summaries. The workaround we are doing is to uncheck that part of Visit Summaries but we would prefer to remove the former employee from the Care plan . . . .
Support told us that there is no way to do this for closed Care Plans.  Anyone out there have a solution?
Thanks in advance!