What happens if someone leaves or I remove them?

They move to the Free plan. Their private budgets stay theirs; what they added to a shared budget stays with the household, and their scanning stops drawing from your pool.