P2P - Removing provider

I have had several providers leave over the last year.

How do I get them out of my P2P?

I can’t seem to locate a disable button. We have made the provider inactive however we still get her P2P incoming referrals.