We’ve already seen some AI software that can upsample low-res images. You know, CSI-style. Face Depixelizer is another AI-powered software, particularly focused on faces. It can take a pixelated, low-res photo and turn it into a realistic portrait. While the results are pretty impressive – the app doesn’t come without its quirks.
Face Depixelizer relies on StyleGAN, the same technology that creates faces of people that don’t exist. It was made by Russian coder Denis Malimonov, who shared it on GitHub and Colab. Basically, the software takes a heavily pixelated photo, analyzes the database, and generates a face that would have the matching features.
Face Depixelizer
Given a low-resolution input image, model generates high-resolution images that are perceptually realistic and downscale correctly.
?GitHub: https://t.co/0WBxkyWkiK
?Colab: https://t.co/q9SIm4ha5pP.S. Colab is based on thehttps://t.co/fvEvXKvWk2 pic.twitter.com/lplP75yLha
— Bomze (@tg_bomze) June 19, 2020
The app like this could have different applications. One of them is breaking the anonymity of people in pixelated videos and photos. While Denis points out that it couldn’t restore the original face, he believes that it could “help with the identification of facial features.”
This tool will not restore the original face, however, it can help with the identification of facial features.
— Bomze (@tg_bomze) June 20, 2020
Some Twitter users found a way more fun purpose of the app. It helped them to imagine what video game characters would look like if they were real people. Some results were epic, but the others… Well, see for yourself:
With default settings, I got this result. pic.twitter.com/mRkqqTwhJF
— Bomze (@tg_bomze) June 20, 2020
So that one is Wolfenstein, here is Doom pic.twitter.com/ixpItQyJ5q
— Hani ✊?? (@h_bash) June 20, 2020
my effort pic.twitter.com/48DCgEfKn7
— Linguica (@andrewrstine) June 20, 2020
yeesh pic.twitter.com/TCXFLtDKNV
— general yikes (@said_mitch) June 20, 2020
even creepier in its own way pic.twitter.com/WESdfkaKQf
— general yikes (@said_mitch) June 20, 2020
All interpretations downscale to the same pixels, so this is an equally valid real life DoomGuy. pic.twitter.com/RwjZSFk9Tg
— Jonathan Fly ? (@jonathanfly) June 20, 2020
eehhh pic.twitter.com/72Y4zyvKXx
— Moritz Klack (@moklick) June 20, 2020
The app turned pixelated face of Donald Trump into a cute little girl. That’s another proof that artificial intelligence isn’t always all that intelligent, I guess:
— Moritz Klack (@moklick) June 20, 2020
Finally, Face Depixelizer shows a feature that can be troublesome. Apparently, the app does “blackface” as one of the users noticed. The AI was trained on Caucasian faces, so it gets pretty confused when the input image is a pixelated face of a black person.
*beep boop* AI does blackface. pic.twitter.com/BeUDoAsfvj
— Kiloku (@Kiloku) June 20, 2020
I also tried with Samuel L Jackson and it wasn’t much better. I guess the images used to train the AI were of predominantly white people? pic.twitter.com/nplylusczo
— Kiloku (@Kiloku) June 20, 2020
As I mentioned, Face Depixelizer can help revealing facial features of people whose faces are obscured. But judging from the results, it could use some more training before that happens. In the meantime, you can have some fun with it and try it out here. If you’ve ever wondered what video game characters from your childhood would look like as humans, maybe this app will help you.
[via PetaPixel]
CSI Miami had it years ago… ???
The last one with Samuel Jackson is quite wrong.
The glasses have disappeared, The head inclinations is now changed, the tee neck i completely different.
And I’m not even talking the weird black color on a white dude to fit the original skin tone.
It’s look like the AI is looking to a databank image and find the one fitting the possible without recreating anything.
So, no. It’s not working at all for now.
Think about the fun with Minecraft!