Researchers demo AI that can change the weather and time of day in photos

[Paul2]

NVIDIA Research is showing off a new project that uses artificial intelligence to change the time of day and weather in an image. The technology is called "unsupervised image-to-image translation," and it involves a newly-created framework capable of producing high-quality image translations, such as turning a day photo into a night photo, or a summer photo into a winter photo.

It is, to use the technical term: bananas.

Unsupervised, in this case, refers to a type of AI training that doesn't involve precise examples upon which the final results can be based. This is due to the variability inherent in taking one type of image, such as one showing a summer day, and translating it into a winter scene. Discussing this, the researchers explained in an abstract:

We compare the proposed framework with competing approaches and present high quality image translation results on various challenging unsupervised image translation tasks, including street scene image translation, animal image translation, and face image translation.

The team provides several before-and-after examples of their AI's work, demonstrating instances of a sunny day with blue sky being transformed into an overcast day, and a snow-covered winter environment being transformed into a sunny green environment.

The video below shows a video scene transformed from winter to summer:

NVIDIA also shared a video of a day scene transformed in night scene, though the change is far more obvious in this example:

Finally, the technology can also be used to transform one species into another, such as turning a house cat into a cheetah:

The team has shared a Google Photos album containing before-and-after images created with the AI, so if you want to see more photo editing madness, you can find it here.

Of course, the transitions are FAR from perfect at this stage, but some of the swaps are so extreme that even the imperfect creations still feel way beyond a computer's capacity to do by itself. Adobe's "Deep Fill" and "Project Cloak" are starting to look like a very small taste of the coming AI photo and video editing revolution.

https://www.dpreview.com/news/5763632147/researchers-demo-ai-that-can-change-the-weather-and-time-of-day-in-photos

its scary how far technology has come to.

[Titan]

Before long we'll be bowing down to our cybernetic overlords.