DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

This AI tool fills in the gaps in any image, even portraits

Jul 17, 2019 by Dunja Djudjic 6 Comments

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

From relighting images to removing backgrounds, the applications of AI tools in photography are many. The new AI-powered tool introduced by Chinese scientists can accurately fill in the blank spaces in all kinds of photos. Be it a front of a building, a landscape photo, even a portrait – the AI is trained to fill in the gap surprisingly accurately.

The researchers have named the tool PEN-Net (Pyramid-context ENcoder Network). It was developed as a collaborative project between Sun Yat-sen University in Guangzhou and Beijing’s Microsoft Research lab in China. The technique is called inpainting and uses deep learning technology to fill in the blanks in two possible ways. It either copies the existing patches on the missing of the photo or generates completely new areas in those missing parts. For example, in the photos of faces, the tool has to recreate the missing part of the image entirely from scratch. The results are pretty realistic, they are achieved fast, and the scientists note that the tool is also very quick to learn. Here are a couple of examples:

According to the researchers, this isn’t the first time inpainting has been introduced. However, it gives more accurate results than the previously developed methods. Lead author of the project, Yanhong Zeng, told Digital Trends that their model preserves both structure and texture coherence in inpainting results. “We are excited to see that our model is capable of generating clearer textures and more reasonable structures than previous works,” he added.

The PEN-Net could have many applications, and as you can imagine, they would mainly be focused on image editing. Zeng confirmed this to Digital Trends, saying that the team will work on applying the technology to image editing programs. It could particularly be useful for object removal and old photo restoration, and the latter was my first thought. Along with AI-powered colorization tools, we could get helpful apps that would help with bringing old and damaged photos to life.

If you’d like to read the full paper about PEN-Net, it’s available on Arxiv.

[via Digital Trends; image credits: Sun Yat-sen University, Microsoft Research lab Beijing]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

The NONS SL42 Mark II adds EF mount and actually fills the medium format Instax frame This Kodak Portra promotional video from 1998 fills us with glorious nostalgia Default ThumbnailDouble Portraits – Portraits of Projections of Portraits This new image mapping website could be an invaluable tool for location and landscape photographers

Filed Under: news Tagged With: AI, Artificial Intelligence, neural network, Neural Networks

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« DJI’s new Ronin-SC is a lightweight one-handed gimbal for mirrorless cameras
This website restores and colorizes your vintage photos in no time »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy