Automatic Mixed Painting

Al ROBOLAB. University of Luxembourg | K. Murugaraj, I. Schandeler | 2022

Guess what was added to the painting!

Slide to reveal the original artwork.

This technology shows an interesting application of artificial intelligence: it adds a new object to any painting and blends it flawlessly into the original masterpiece. See how art can be expanded and reimagined.

A peak behind "Automatic Mixed Painting"

Imagine you have two images: a painting you want to change and a new element or object you want to add. How can we make this element look like it always belonged in the painting?
This is where “Automatic Mixed Painting” comes in. It uses an artificial intelligence program that learns different ways of drawing from millions of artworks. This AI program, trained in 2022, helps us understand the colors, textures, and styles of different paintings and is able to add new elements to an artwork by adapting the style in simple steps.

Original Artwork

Adding Object

Style Transfer

Original Artwork

Style Transfer

Adding Object

A more modern technology gaining similar results

Recently, technology allowing AI programs to understand human language and being able to interact with different inputs has allowed for similar results. Using Adobe Firefly, a part of an image can be replaced, either freely by the AI or with a prompt (a text input) hinting the AI as to how to change the image. All images seen below were generated in the summer of 2024. An example of this process can be seen below:

Original Artwork

Changing Artwork with a prompt

AI generated Artwork

Original Artwork

Changing Artwork with a prompt

AI generated Artwork

Can you find the original Artwork?

Click or hover over an image to reveal the answer!

This image is a fake

The red woolen hats were added with a prompt to the AI.

This image is a fake

The blue bowtie was added with a prompt to the AI.

This image is the original

American Gothic
by Grant Wood

This image is a fake

The window in the back was changed with a prompt to the AI.

This image is a fake

The landscape was added with a prompt to the AI.

This image is a fake

The left boat was removed with a prompt to the AI.

This image is a fake

The left boat was removed, and the landscape was added with a prompt to the AI.

This image is the original

The Great Wave off Kanagawa by Hokusai

This image is a fake

The sleeping dog and the sun were added with a prompt to the AI.

This image is the original

Wanderer above the Sea of Fog
by Caspar David Friedrich

This image is a fake

The erupting volcano was added with a prompt to the AI.

This image is a fake

The top hat and the sun were added with a prompt to the AI.

This image is the original

Icarus by Henri Matisse

This image is a fake

Two stars were added and the red point has moved with a prompt to the AI.

This image is a fake

The red point was removed and two stars were added with a prompt to the AI.

This image is a fake

The red point was removes with a prompt to the AI.

This image is a fake

The swimmer and some flowers were added with a prompt to the AI.

This image is the original

The Water Lilies
by Claude Monet

This image is a fake

The purple flowers on the top were added with a prompt to the AI.

This image is a fake

A few flowers were added with a prompt to the AI.

This image is the original

The Vision to the Youth Bartholomew
by Mikhail Vasilyevich Nesterov

This image is a fake

The chest and the river were added with a prompt to the AI.

This image is a fake

The river was added and the boy was removed with a prompt to the AI.

This image is a fake

The water in the background was added with a prompt to the AI.

This image is a fake

The hats of the dogs were added and the light removed with a prompt to the AI.

This image is a fake

The red light was removed with a prompt to the AI.

This image is a fake

The dog on the left was removed with a prompt to the AI.

This image is the original

A Friend In Need
by Cassius Marcellus Coolidge

This image is a fake

The shading was removed and a flower meadow was added with a prompt to the AI.

This image is a fake

The flowers were changed to a torch and the shading was removed with a prompt to the AI.

This image is the original

Love Is in the Air by Banksy

This image is a fake

The flowers were changed to a torch with a prompt to the AI.

This image is a fake

The right cloud was removed with a prompt to the AI.

This image is a fake

The hole was added with a prompt to the AI.

This image is a fake

The ground around the tower was changed with a prompt to the AI.

This image is the original

The Tower of Babel
by Pieter Bruegel the Elder

This image is a fake

The long hair was removed with a prompt to the AI.

This image is a fake

The dressing gown was changed with a prompt to the AI.

This image is the original

Girl with a Pearl Earring
by Johannes Vermeer

This image is a fake

The dressing gown was changed and the sunglasses added with a prompt to the AI.

This image is the original

The Arnolfini Wedding
by Jan van Eyck

This image is a fake

The hat was changed with a prompt to the AI.

This image is a fake

The hat was removed with a prompt to the AI.

This image is a fake

The hat was changed with a prompt to the AI.

This image is a fake

The two trees were added with a prompt to the AI.

This image is the original

The Persistence of Memory
by Salvador Dali

This image is a fake

The lying horse was removed with a prompt to the AI.

This image is a fake

The red thing was removed with a prompt to the AI.

This image is the original

The Oath of the Horatii
by Jacques-Louis David

This image is a fake

The statue was added and the swords removed with a prompt to the AI.

This image is a fake

The statue was added with a prompt to the AI.

This image is a fake

The swords were removed with a prompt to the AI.

This image is the original

The Son of Man
by René Magritte

This image is a fake

The red tie was removed with a prompt to the AI.

This image is a fake

The leaves on the apple, the wall and the red tie were removed with a prompt to the AI.

This image is a fake

The wall and the red tie were removed with a prompt to the AI.

This image is a fake

The boat was added with a prompt to the AI.

This image is a fake

The fish were added and the swimmer removed with a prompt to the AI.

This image is the original

"Jaws" Book Cover
by Roger Kastel

This image is a fake

The swimmer was removed with a prompt to the AI.

This image is a fake

The castle was removed with a prompt to the AI.

This image is the original

Poster from the movie Shrek

This image is a fake

The faces of Shrek and the donkey were changed, and the sun was added with a prompt to the AI.

This image is a fake

The castle was removed and the faces were changed with a prompt to the AI.