FairErase-FCL: Fairness-Aware Federated Continual Unlearning under Non-IID Educational Data
PDF

Keywords

federated unlearning
continual learning
algorithmic fairness
non-IID educational data
equal opportunity
post-deletion governance

Abstract

Federated unlearning is commonly evaluated by deletion speed, distance to retraining, and average predictive accuracy. These criteria can miss a consequential post-deletion effect: a client withdrawal may alter the distribution of representation across protected groups. Under non-independent and non-identically distributed educational data, the withdrawn institution may contain a disproportionate share of one group. Reversing its update or resetting deletion-sensitive parameters can therefore change group-specific false-negative rates even when average utility remains stable. This paper introduces FairErase-FCL, a fairness-aware sparse repair method for federated continual unlearning. The method identifies coordinates most sensitive to the withdrawn client, builds a group-stratified buffer from data that remain authorized, and optimizes predictive loss together with a smooth equal-opportunity penalty on a restricted repair mask. We evaluate 14 heterogeneous clients, five temporal cohorts, 26 synthetic features, and 15 paired random seeds. The client with the largest protected-group proportion is removed in each run. FairErase-FCL achieves 78.96% ± 1.85% balanced accuracy, 0.42 percentage points below full retraining. Its equal-opportunity gap is 6.65 percentage points, significantly lower than the 8.05 points produced by full retraining (t(14) = -4.55, p < 0.001), at an estimated 24% of retraining computation. Worst-group accuracy does not improve, revealing a genuine conflict between fairness objectives. The study shows that post-deletion release criteria should report average utility, deletion evidence, and several group metrics rather than accepting a single aggregate accuracy.

PDF

References

McMahan, B., Moore, E., Ramage, D., Hampson, S., and Agüera y Arcas, B. (2017). Communication-Efficient Learning of Deep Networks from Decentralized Data. AISTATS, PMLR 54, 1273-1282. https://proceedings.mlr.press/v54/mcmahan17a.html

Li, T., Sanjabi, M., Beirami, A., and Smith, V. (2020). Fair Resource Allocation in Federated Learning. ICLR. https://openreview.net/pdf?id=BJzvEqrj2V

Rychener, Y., Kuhn, D., and Hu, Y. (2025). Global Group Fairness in Federated Learning via Function Tracking. AISTATS, PMLR 258, 865-873. https://proceedings.mlr.press/v258/rychener25a.html

Pentyala, S., et al. (2025). Privacy-Preserving Group Fairness in Cross-Device Federated Learning. FAccT. https://proceedings.mlr.press/v279/pentyala25a.html

Karimireddy, S. P., Kale, S., Mohri, M., et al. (2020). SCAFFOLD: Stochastic Controlled Averaging for Federated Learning. ICML, PMLR 119, 5132-5143. https://proceedings.mlr.press/v119/karimireddy20a.html

Hardt, M., Price, E., and Srebro, N. (2016). Equality of Opportunity in Supervised Learning. NeurIPS 29. https://papers.nips.cc/paper_files/paper/2016/hash/6a9659feb1216f14f7384ba499518b38-Abstract.html

Liu, G., Ma, X., Yang, Y., Wang, C., and Liu, J. (2020). Federated Unlearning. arXiv:2012.13891. https://arxiv.org/abs/2012.13891

Fraboni, Y., Van Waerebeke, M., Scaman, K., et al. (2024). SIFU: Sequential Informed Federated Unlearning for Efficient and Provable Client Unlearning in Federated Optimization. AISTATS, PMLR 238, 3457-3465. https://proceedings.mlr.press/v238/fraboni24a.html

Nguyen, T.-H., Vu, H.-P., Nguyen, D. T., et al. (2024). Empirical Study of Federated Unlearning: Efficiency and Effectiveness. ACML, PMLR 222, 959-974. https://proceedings.mlr.press/v222/nguyen24a.html

Özdenizci, O., Rueckert, E., and Legenstein, R. (2025). Privacy-Aware Lifelong Learning. arXiv:2505.10941. https://arxiv.org/abs/2505.10941

Serra, J., Suris, D., Miron, M., and Karatzoglou, A. (2018). Overcoming Catastrophic Forgetting with Hard Attention to the Task. ICML, PMLR 80, 4548-4557. https://proceedings.mlr.press/v80/serra18a.html

European Parliament and Council. (2024). Regulation (EU) 2024/1689: Artificial Intelligence Act, Recital 56 and Annex III. https://eur-lex.europa.eu/eli/reg/2024/1689/oj

Tabassi, E. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1. https://doi.org/10.6028/NIST.AI.100-1

Gupta, V., Jung, C., Neel, S., et al. (2021). Adaptive Machine Unlearning. NeurIPS 34. https://proceedings.neurips.cc/paper/2021/hash/87f7ee4fdb57bdfd52179947211b7ebb-Abstract.html

Tao, J., Liu, Z., Lyu, R., and Cao, X. (2026). A Scalable Data Governance Architecture for Privacy-Aware Intelligent Learning Systems in Lifelong. Course-supplied PDF manuscript.