2020Miolane VAEGAN
Citation
Miolane, N.; Poitevin, F.; Li, Y.-T., Holmes, S. Estimation of orientation and camera parameters from cryo-electron microscopy images with variational autoencoders and generative adversarial networks, Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, 970-971
Abstract
Cryo-electron microscopy (cryo-EM) is capable of producing reconstructed 3D images of biomolecules at nearatomic resolution. However, raw cryo-EM images are only highly corrupted - noisy and band-pass filtered - 2D projections of the target 3D biomolecules. Reconstructing the 3D molecular shape requires the estimation of the orientation of the biomolecule that has produced the given 2D image, and the estimation of camera parameters to correct for intensity defects. Current techniques performing these tasks are often computationally expensive, while the dataset sizes keep growing. There is a need for next-generation algorithms that preserve accuracy while improving speed and scalability. In this paper, we combine variational autoencoders (VAEs) and generative adversarial networks (GANs) to learn a low-dimensional latent representation of cryoEM images. This analysis leads us to design an estimation method for orientation and camera parameters of singleparticle cryo-EM images, which opens the door to faster cryo-EM biomolecule reconstruction.