NVIDIA Research - AI Reconstructs Photos

YouTube description:

Researchers from NVIDIA, led by Guilin Liu, introduced a state-of-the-art deep learning method that can edit images or reconstruct a corrupted image, one that has holes or is missing pixels. The method can also be used to edit images by removing content and filling in the resulting holes. Learn more about their research paper “Image Inpainting for Irregular Holes Using Partial Convolutions”: https://nvda.ws/2K1G243

(H/T @eric3579)
hamsteralliancesays...

I think one of the key things is that it was filling in the eyes with eyes. It was using completely different color eyes even and it knew where they needed to go. Content Aware only uses what's in the image, so it would just fill in that area with flesh and random bits of hair and mouth. This seems to pull from a neural network database thingymajigger.

ChaosEnginesaid:

That's cool, but how is it different from photoshops "content aware fill" that debuted 8 years ago?

bremnetsays...

As hamsteralliance says, ContentAware uses proximity matching and relative area matching. If you tried to fill in the white space with ContentAware, it'd be full of everything except eyes. They nVidia folks used thousands of images to train the neural net (ie generate the model using training data) which has more discrete sequential or spatial relationships between features (ie. eyes go to either side of the nose, below the eyebrows, level, interpupilary distance etc etc). The neural approach ALWAYS needs training data sets - it doesn't appear to (from reading the paper) any adaptive or learning algorithm outside of the neural framework (so, it's not AI in the sense that it learns from any environmental stimulus and alters its response... that I can see anyway. The paper doesn't get into the minutiae). But I'd still date her, if only she'd have me.

hamsteralliancesaid:

I think one of the key things is that it was filling in the eyes with eyes. It was using completely different color eyes even and it knew where they needed to go. Content Aware only uses what's in the image, so it would just fill in that area with flesh and random bits of hair and mouth. This seems to pull from a neural network database thingymajigger.

Send this Article to a Friend



Separate multiple emails with a comma (,); limit 5 recipients






Your email has been sent successfully!

Manage this Video in Your Playlists




notify when someone comments
X

This website uses cookies.

This website uses cookies to improve user experience. By using this website you consent to all cookies in accordance with our Privacy Policy.

I agree
  
Learn More