Beyond deep fakes: Conceptual framework, applications, and research agenda for neural rendering of realistic digital faces

dc.contributor.authorSeymour, Mike
dc.contributor.authorRiemer, Kai
dc.contributor.authorYuan, Lingyao
dc.contributor.authorDennis, Alan
dc.date.accessioned2020-12-24T20:00:49Z
dc.date.available2020-12-24T20:00:49Z
dc.date.issued2021-01-05
dc.description.abstractNeural rendering (NR) has emerged as a novel technology for the generation and animation of realistic digital human faces. NR is based on machine learning techniques such as generative adversarial networks and is used to infer human face features and their animation from large amounts of (video) training data. NR shot to prominence with the deep fake phenomenon, the malicious and unwanted use of someone’s face for deception or satire. In this paper we demonstrate that the potential uses of NR far outstrip its use for deep fakes. We contrast NR approaches with traditional computer graphics approaches, discuss typical types of NR applications in digital face generation, and derive a conceptual framework for both guiding the design of digital characters, and for classifying existing NR use cases. We conclude with research ideas for studying the potential applications and implications of NR-based digital characters.
dc.format.extent10 pages
dc.identifier.doi10.24251/HICSS.2021.590
dc.identifier.isbn978-0-9981331-4-0
dc.identifier.urihttp://hdl.handle.net/10125/71208
dc.language.isoEnglish
dc.relation.ispartofProceedings of the 54th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectAugmented Intelligence
dc.subjectdeep fakes
dc.subjectdigital humans
dc.subjecthci
dc.subjectneural rendering
dc.titleBeyond deep fakes: Conceptual framework, applications, and research agenda for neural rendering of realistic digital faces
prism.startingpage4859

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
0477.pdf
Size:
3.55 MB
Format:
Adobe Portable Document Format