uni-lu-logo

Automatic Mixed Painting

AFFILIATIONS: Al ROBOLAB. University of Luxembourg
AUTHORS: Keerthana Murugaraj, Ingo Schandeler
PROJECT YEAR: 2022

Guess what was added to the painting!

Slide to reveal the original artwork.

expo-8.0 expo-8.1
expo-1.0 expo-1.1
expo-2.0 expo-2.1
expo-4.0 expo-4.1
expo-6.0 expo-6.1
expo-7.0 expo-7.1
expo-10.0 expo-10.1
expo-11.0 expo-11.1

This technology shows an interesting application of artificial intelligence: it adds a new object to any painting and blends it flawlessly into the original masterpiece. See how art can be expanded and reimagined.

A peak behind "Automatic Mixed Painting"

Imagine you have two images: a painting you want to change and a new element or object you want to add. How can we make this element look like it always belonged in the painting?
This is where “Automatic Mixed Painting” comes in. It uses an artificial intelligence program that learns different ways of drawing from millions of artworks. This AI program, trained in 2022, helps us understand the colors, textures, and styles of different paintings and is able to add new elements to an artwork by adapting the style in simple steps.

Original Artwork

Adding Object

Style Transfer

A more modern technology gaining similar results

Recently, technology allowing AI programs to understand human language and being able to interact with different inputs has allowed for similar results. Using Adobe Firefly, a part of an image can be replaced, either freely by the AI or with a prompt (a text input) hinting the AI as to how to change the image. All images seen below were generated in the summer of 2024. An example of this process can be seen below:

Original Artwork

Changing artwork with a prompt

AI generated Artwork

Can you find the original Artwork?

Click or hover over an image to reveal the answer!