Abstract
Training high-quality deep learning models for optical surface inspection requires large diverse datasets, but manufacturing companies are often unwilling or legally prohibited from sharing raw measurement data across facilities due to competitive concerns, customer confidentiality requirements, and data privacy regulations such as GDPR. This data silos problem means that each facility trains on its own limited data, producing models that do not generalize well to other factories, product variants, or measurement equipment configurations. This study proposes a federated learning framework for optical surface inspection that enables multiple manufacturing facilities to collaboratively train a shared inspection model without any facility revealing its raw measurement data to any other facility or to a central server. Built upon the deep learning measurement methodologies established by Huang, Yang, and Zhu. (2023) in 4D thermal imaging and the optical metrology innovations of Huang, Tang, Liu, and Huang (2026), the framework employs differential privacy mechanisms to provide formal privacy guarantees, a Federated Averaging protocol optimized for optical measurement data distributions, and a contribution scoring system that rewards facilities for sharing informative data without exposing what that data contains. Evaluated on a simulated federation of six manufacturing facilities with heterogeneous data distributions, the proposed framework achieves inspection accuracy that is within 6.3% of a centrally trained model while providing formal (ε, δ)-differential privacy guarantees. The framework is demonstrated to enable factories with as few as 500 labeled samples to benefit from the collective knowledge of the entire federation, reaching performance that would otherwise require tens of thousands of samples. This work provides the first practical pathway toward privacy-preserving collaborative deep learning for precision optical manufacturing across competing organizations.
References
Zhou, K., Zhong, L., Liu, J. et al. Unveiling the Role of Western Pacific Subtropical High in Urban Heat Islands Using Local Climate Zones Coupled WRF-BEP/BEM. Earth Syst Environ 10, 363–390 (2026). https://doi.org/10.1007/s41748-025-00589-z
S. Wang, Y. Yu, R. Feldt and D. Parthasarathy, "Automating a Complete Software Test Process Using LLMs: An Automotive Case Study," 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE), Ottawa, ON, Canada, 2025, pp. 373-384, doi: 10.1109/ICSE55347.2025.00211.
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016). Deep learning with differential privacy. In *Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security* (pp. 308–318). ACM. https://doi.org/10.1145/2976749.2978318
Carlini, N., Tramèr, F., Dwork, C., Honaker, J., & Smith, A. (2021). Privacy in machine learning: A unifying perspective. *ACM Computing Surveys*, 54(3), 1–38. https://doi.org/10.1145/3442180
Dwork, C., Rothblum, G. N., & Vadhan, S. (2014). Privacy, accuracy, and consistency too: A fundamental trade-off for data analysis. In *Proceedings of the 1st Innovations in Theoretical Computer Science Conference* (pp. 196–210). ACM. https://doi.org/10.1145/2554797.2554819
Huang, H., Tang, J., Liu, T., & Huang, M. (2026). Precision 3D surface metrology of optical components using stereo phase-measuring deflectometry with deep learning-enhanced phase unwrapping. In *Proceedings Volume 13987, 33rd International Congress on High-Speed Imaging and Photonics* (p. 1398704). SPIE. https://doi.org/10.1117/12.3093993
Huang, H., Yang, Y., & Zhu, Y. (2023). Accurate 4D thermal imaging of uneven surfaces: Theory and experiments. *International Journal of Heat and Mass Transfer*, 216, 124580. https://doi.org/10.1016/j.ijheatmasstransfer.2023.124580
McMahan, B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. (2017). Communication-efficient learning of deep networks from decentralized data. In *Proceedings of the 20th International Conference on Artificial Intelligence and Statistics* (pp. 1273–1282). PMLR.
Wang, S., Yu, Y., Feldt, R., & Parthasarathy, D. (2025). Automating a complete software test process using llms: An automotive case study. arXiv preprint arXiv:2502.04008. https://doi.org/10.1109/ICSE55347.2025.00211
Zhu, Y., Liu, Q. Hybrid graph attention network-LSTM models for causal-aware supply chain forecasting. J Intell Manuf (2026). https://doi.org/10.1007/s10845-025-02782-3
Zhu, Y., & Liu, Q. (2025). Toward transparent groundwater contamination risk forecasting: Integrating causal discovery and Bayesian graph neural networks. Science of the Total Environment, 998, 180233. https://doi.org/10.1016/j.scitotenv.2025.180233
Zhu, Y. Application of a QPSO-optimized CNN-LSTM model in water quality prediction. Discov Water 4, 100 (2024). https://doi.org/10.1007/s43832-024-00161-2
Zhou, K., Zhong, L., Liu, J. et al. Unveiling the Role of Western Pacific Subtropical High in Urban Heat Islands Using Local Climate Zones Coupled WRF-BEP/BEM. Earth Syst Environ 10, 363–390 (2026). https://doi.org/10.1007/s41748-025-00589-z
Zhao, Y., Zhong, L., Zhou, K., Liu, B., & Shu, W. (2024). Responses of the urban atmospheric thermal environment to two distinct heat waves and their changes with future urban expansion in a Chinese megacity. Geophysical Research Letters, 51(11), Article e2024GL109018. https://doi.org/10.1029/2024GL109018
Huang, H., Tang, J., Liu, T., & Huang, M. (2026). Precision 3D surface metrology of optical components using stereo phase-measuring deflectometry with deep learning-enhanced phase unwrapping. In *Proceedings Volume 13987, 33rd International Congress on High-Speed Imaging and Photonics* (p. 1398704). SPIE. https://doi.org/10.1117/12.3093993
Huang, H., Yang, Y., & Zhu, Y. (2023). Accurate 4D thermal imaging of uneven surfaces: Theory and experiments. *International Journal of Heat and Mass Transfer*, 216, 124580. https://doi.org/10.1016/j.ijheatmasstransfer.2023.124580
Wang, S., Yu, Y., Feldt, R., & Parthasarathy, D. (2025). Automating a complete software test process
using LLMs: An automotive case study. 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE), 1–12. https://doi.org/10.1109/ICSE55347.2025.00211
