Shruti Agarwal and Hany Farid use facial quirks to unmask ‘deepfakes’

CS graduate student Shruti Agarwal and her thesis advisor Prof. Hany Farid have created a new weapon in the war against “deepfakes,” the hyper-realistic AI-generated videos of people appearing to say and do things they never actually said or did.  The new forensic technique, which uses the subtle characteristics of how a person speaks to recognize whether a new video of that individual is real, was presented this week at the Computer Vision and Pattern Recognition conference in Long Beach.  “The basic idea is we can build these soft biometric models of various world leaders, such as 2020 presidential candidates,” said Farid, “and then as the videos start to break, for example, we can analyze them and try to determine if we think they are real or not.”