Youtube BabyZone has created something incredibly unique, a deep fake of 2018’sSpider-Manvideo game in which the characters are replaced with the actors from the 2002Spider-Manfilm adaptation. It’s a five-minute video with complete facial replacement, resulting in an incredibly eerie piece of art that’s well worth watching.
Despite the broad range ofSpider-Manrelated media available, the 2002Sam Raimiadaptation starring Tobey Maguire, Kirsten Dunst, and Willem Dafoe stands out when it comes to obsessive fanbases. The popular Raimi Memes subreddit is just one of many examples of theSpider-Manfilm’s longevity. It was only a matter of time before that fandom crossed over with 2018’sMarvel’s Spider-Manvideo game, though few would ever have predicted it would turn out like this.
RELATED:Creepy App Adds Your Face To Video Game Characters
Only four of theSpider-Manfilm’s actors are actually inserted into the gameplay footage, those beingTobey Maguire asSpider-Man, Kirsten Dunst as Mary Jane, Willem Dafoe as Norman Osbourn, and Alfred Molina as Doctor Octopus. Miles Morales is featured prominently in the footage, but Miles wasn’t a character in the 2002 movie, so there’s no actor’s face to use as a replacement. Just those four actors' faces being replaced is more than enough for the purposes of the video, of course.
As for the quality of the deep fake, it’s astonishingly well-done. One would think thatdeep fake video editing AImay not be suitable for video game graphics, since it seems to be used largely for real-life recordings, but that apparently isn’t the case. Maguire, Dunst, and Dafoe’s faces aren’t just digitized to replace the in-gameSpider-Mancharacters, but also adopt the game’s CG stylization in the process. They very much look like they’ve been modeled by a professional gaming artist.
That said, they’re certainly not perfect. The deep fake works very well when theSpider-Mancharactersare facing the camera, but if they’re turned to the side then it doesn’t work well at all. Mary Jane specifically appears to revert entirely to her original facial design when seen from the side. Deep fake AI is an evolving technology, of course, so perfect conversions aren’t to be expected.
To be fair, the creator of this video, BabyZone, put an incredible amount of work into thedeep fake. In the Youtube video’s description, they explain how they created a “faceset” for each actor as well as “heavily editing” the footage they produced. They likely only kept the footage that looked the best. Nevertheless, they did this all using DeepFaceLab 2.0 software on their own. It’s exciting to think about what other kinds of fun gaming deep fakes could be made, too.
Spider-Manis available now on PS4.
MORE:Spider-Man PS4: 5 Ways It’s The Best Spider-Man Game Of All-Time (& 5 Why It’s Spider-Man 2)