AICurious Logo

What is: LipGAN?

SourceTowards Automatic Face-to-Face Translation
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

LipGAN is a generative adversarial network for generating realistic talking faces conditioned on translated speech. It employs an adversary that measures the extent of lip synchronization in the frames generated by the generator. The system is capable of handling faces in random poses without the need for realignment to a template pose. LipGAN is a fully self-supervised approach that learns a phoneme-viseme mapping, making it language independent.