DOReN: Towards Efficient Deep Convolutional Neural Networks with Fully Homomorphic Encryption

DOReN: Towards Efficient Deep Convolutional Neural Networks with Fully Homomorphic Encryption
Title:
DOReN: Towards Efficient Deep Convolutional Neural Networks with Fully Homomorphic Encryption
Other Titles:
IEEE Transactions on Information Forensics and Security
Publication Date:
21 June 2021
Citation:
S. Meftah, B. H. M. Tan, C. F. Mun, K. M. M. Aung, B. Veeravalli and V. Chandrasekhar, DOReN: Towards Efficient Deep Convolutional Neural Networks with Fully Homomorphic Encryption; in IEEE Transactions on Information Forensics and Security, doi: 10.1109/TIFS.2021.3090959.
Abstract:
Fully homomorphic encryption (FHE) is a powerful cryptographic primitive to secure outsourced computations against an untrusted third-party provider. With the growing demand for AI and the usefulness of machine learning as a service (MLaaS), the need for secure training and inference of artificial neural networks is rising. However, the computational complexity of existing FHE schemes has been a strong deterrent to this. Prior works suffered from accuracy degradation, lack of scalability, and ciphertext expansion issues. In this paper, we take the first step towards the problem of space-efficiency in evaluating deep neural networks through designing DOReN: a low depth, batched neuron that can simultaneously evaluate multiple quantized ReLU-activated neurons on encrypted data without approximations. Our circuit design reduced the complexity of the accumulator circuit depth from \(O(\log m \cdot \log n)\) to \(O(\log m + \log n)\) for \(n\) bit integers. The experimental results show that the amortized processing time of our homomorphic neuron is approximately 1.26 seconds for 300 inputs and less than 0.13 seconds for 10 inputs at 80~bit security, which is a 20 fold improvement upon Lou and Jiang, NeurIPS 2019.
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the Agency for Science, Technology and Research - RIE2020 Advanced Manufacturing and Engineering (AME) Programmatic Programme
Grant Reference no. : A19E3b0099
Description:
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
ISSN:
1556-6013
1556-6021
Files uploaded:

File Size Format Action
doren-accepted.pdf 2.92 MB PDF Request a copy