Towards high performance homomorphic encryption for inference tasks on CPU: An MPI approach

Page view(s)
22
Checked on Jun 28, 2024
Towards high performance homomorphic encryption for inference tasks on CPU: An MPI approach
Title:
Towards high performance homomorphic encryption for inference tasks on CPU: An MPI approach
Journal Title:
Future Generation Computer Systems
Publication Date:
01 April 2022
Citation:
Meftah, S., Tan, B. H. M., Aung, K. M. M., Yuxiao, L., Jie, L., & Veeravalli, B. (2022). Towards high performance homomorphic encryption for inference tasks on CPU: An MPI approach. Future Generation Computer Systems, 134, 13–21. https://doi.org/10.1016/j.future.2022.03.033
Abstract:
Fully homomorphic encryption (FHE) is a powerful tool enabling secure outsourcing to untrusted third-parties. As AI technologies mature and companies start offering AI-as-a-service (AIaaS), the privacy of their customers’ data needs to be considered but the high overhead of existing FHE schemes is a major limitation. Prior work tried to address this but suffered accuracy degradation, lack of scalability, ciphertext expansion, and impractical performance issues. In this paper, we explore the utility of High-Performance Computing systems for accelerating the secure evaluation of deep convolutional neural networks (CNN) with FHE. We examine previous encrypted neural network architectures and propose a holistic re-design for the HPC environment, which introduces a new consideration for the latency of inter-node communication. The new architecture was implemented with MPI and OpenMP and its performance benchmarked against state-of-the-art FHE-based CNN evaluation methods. Our solution achieved improvements of between for various CIFAR10 CNN architectures and more than for AlexNet, bringing FHE-based evaluation of AlexNet down from several hundred days to within 14 h. Such findings pave the way towards practical inference on encrypted medium resolution images through the use of HPC systems.
License type:
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Funding Info:
This research / project is supported by the A*STAR - Advanced Manufacturing and Engineering (AME) Programmatic Programme
Grant Reference no. : A19E3b0099
Description:
ISSN:
0167-739X
Files uploaded:

File Size Format Action
fcgs-2021-paper.pdf 356.82 KB PDF Open