Best Practice for Disabling Providers

Hello,
Does anyone have a workflow for disabling providers that leave the practice?  For the last few years we have struggled with the appropriate way to disable their account.  We would prefer to inactivate the provider but billing indicates this would impact claims.  We used to add ZZ to the provider last name so they are not searchable in the system but this also impacts claims.  We have resorted to leaving their account active for 2-3 months until all claims have processed which means someone has to watch their buckets daily.  We can turn on the out-of-office but that only works for tel encounters.