Deep Daze Fourier Text-to-Image

More Fascinating Text-to-Image

This time “Deep Daze Fourier” from Vadim Epstein. Code available in this notebook.

Compared to the last Deep Daze that generated washed out and pastel shaded results this Deep Daze creates images with sharp, crisp bright colors.

Sample results

“Shrek eating pizza”

Deep Daze Fourier - Shrek Eating Pizza

Deep Daze Fourier - Shrek Eating Pizza

Deep Daze Fourier - Shrek Eating Pizza

Deep Daze Fourier - Shrek Eating Pizza

“H R Giger”

Deep Daze Fourier - H R Giger

Deep Daze Fourier - H R Giger

Deep Daze Fourier - H R Giger

Deep Daze Fourier - H R Giger

“Freddy Krueger”

Deep Daze Fourier - Freddy Krueger

Deep Daze Fourier - Freddy Krueger

Deep Daze Fourier - Freddy Krueger

Deep Daze Fourier - Freddy Krueger

“Surrealist Homer Simpson”

Deep Daze Fourier - Surrealist Homer Simpson

Deep Daze Fourier - Surrealist Homer Simpson

Deep Daze Fourier - Surrealist Homer Simpson

Deep Daze Fourier - Surrealist Homer Simpson

“rose bush”

Deep Daze Fourier - Rose Bush

Deep Daze Fourier - Rose Bush

Deep Daze Fourier - Rose Bush

Deep Daze Fourier - Rose Bush

Availability

This and the previous Text-to-Image systems I have experimented with (here, here and here) are now supported by a GUI front end in Visions of Chaos. As long as you install these prerequisites and have a decent GPU you will be able to run these systems yourself.

Text-to-Image GUI

For those who love to tinker I have now added a bunch more of the script parameters so you no longer have to edit the Python source code outside Visions of Chaos.

Other Text-to-Image

If you know of any other Text-to-Image systems (with sharable open-source code) then please let me know. All of the Text-to-Image systems I have tested so far all have their own unique behaviors and outputs so I will always be on the lookout for more new variations.

Jason.

Aleph2Image Text-to-Image

Previously I experimented with Big Sleep and other Text-to-Image systems.

This post covers variations of Aleph2Image Text-to_Image. Originally coded by Ryan Murdock.


Aleph2Image “Gamma”

Code from this colab. This one seems to evolve white blotches that grow and take over the entire image. Before the white out stage the images tend to have too much contrast. Previous results from Deep Daze were too washed out, this one is too “contrasty”. If they could both be pushed towards that “sweet spot” they would both look much better.

“surrealism”

Aleph2Image Gamma - Surrealism

Aleph2Image Gamma - Surrealism

Aleph2Image Gamma - Surrealism

Aleph2Image Gamma - Surrealism

“H R Giger”

Aleph2Image Gamma - H R Giger

Aleph2Image Gamma - H R Giger

Aleph2Image Gamma - H R Giger

Aleph2Image Gamma - H R Giger

“seascape oil painting”

Aleph2Image Gamma - Seascape Oil Painting

Aleph2Image Gamma - Seascape Oil Painting

Aleph2Image Gamma - Seascape Oil Painting

Aleph2Image Gamma - Seascape Oil Painting

“frogs in the rain”

Aleph2Image Gamma - Frogs In The Rain

Aleph2Image Gamma - Frogs In The Rain

Aleph2Image Gamma - Frogs In The Rain

Aleph2Image Gamma - Frogs In The Rain


Aleph2Image “Delta”

Code from this colab. A newer revision of Aleph2Image that doesn’t have the white out issues. The resulting images have much more vibrant colors.

“surrealism”

Aleph2Image Delta - Surrealism

Aleph2Image Delta - Surrealism

Aleph2Image Delta - Surrealism

Aleph2Image Delta - Surrealism

“H R Giger”

Aleph2Image Delta - H R Giger

Aleph2Image Delta - H R Giger

Aleph2Image Delta - H R Giger

Aleph2Image Delta - H R Giger

“seascape oil painting”

Aleph2Image Delta - Seascape Oil Painting

Aleph2Image Delta - Seascape Oil Painting

Aleph2Image Delta - Seascape Oil Painting

Aleph2Image Delta - Seascape Oil Painting

“frogs in the rain”

Aleph2Image Delta - Frogs In The Rain

Aleph2Image Delta - Frogs In The Rain

Aleph2Image Delta - Frogs In The Rain

Aleph2Image Delta - Frogs In The Rain


Improved Aleph2Image “Delta” v2

Code from this colab. A newer revision of Aleph2Image Delta that gives much better results, although the results tend to be similar to each other for each prompt text. This and Big Sleep would be the best 2 Text-to-Image systems I have experimented with so far.

“surrealism”

Aleph2Image Delta v2 - Surrealism

Aleph2Image Delta v2 - Surrealism

Aleph2Image Delta v2 - Surrealism

Aleph2Image Delta v2 - Surrealism

“H R Giger”

Aleph2Image Delta v2 - H R Giger

Aleph2Image Delta v2 - H R Giger

Aleph2Image Delta v2 - H R Giger

Aleph2Image Delta v2 - H R Giger

“seascape oil painting”

Aleph2Image Delta v2 - Seascape Oil Painting

Aleph2Image Delta v2 - Seascape Oil Painting

Aleph2Image Delta v2 - Seascape Oil Painting

Aleph2Image Delta v2 - Seascape Oil Painting

“frogs in the rain”

Aleph2Image Delta v2 - Frogs In The Rain

Aleph2Image Delta v2 - Frogs In The Rain

Aleph2Image Delta v2 - Frogs In The Rain

Aleph2Image Delta v2 - Frogs In The Rain


Easy GUI Front End

I include a simple GUI dialog front end for these Text-to-Image systems in Visions of Chaos. As long as you have the prerequisites installed you will be able to convert text prompts into single or multiple images.

Text-to-Image GUI

You do need a GPU with lots of VRAM for these to work (especially the 512×512 image models).

Jason.

Further Explorations Into Text-to-Image Machine Learning

After my initial experiments with Big Sleep Text-to-Image generation I looked around for some more examples to play with. I was really impressed with Big Sleep and you can see some examples of Big Sleep output in that original post. I still think Big Sleep is the best Text-to-Image code I have used so far and better than what is in this post.


Deep Daze

Deep Daze is by Phil Wang and the source code is available here.

Deep Daze tends to generate collage-like images. As the first example image shows the resulting images have a washed out or faded look. I put the rest of the example Deep Daze images through a quick Auto White Balance pass in GIMP.

“H R Giger”

DeepDaze - H R Giger

DeepDaze - H R Giger

“Rainforest”

DeepDaze - Rainforest

“night club”

DeepDaze - Night Club

“seascape painting”

DeepDaze - Seascape Painting

“flowing water”

DeepDaze - Flowing Water


VQGAN-CLIP z+quantize

VQGAN-CLIP using a z+quantize method is from Katherine Crowson. Source code is available here.

This method also has the option to use an image to seed the initial model rather than just random noise, but the following examples were all seeded with noise. The resulting images tend to be divided up into rectangular regions, but the resulting imagery is interesting.

“H R Giger”

VQGAN-CLIP z+quantize - H R Giger

VQGAN-CLIP z+quantize - H R Giger

VQGAN-CLIP z+quantize - H R Giger

VQGAN-CLIP z+quantize - H R Giger

“rainforest”

VQGAN-CLIP z+quantize - Rainforest

VQGAN-CLIP z+quantize - Rainforest

VQGAN-CLIP z+quantize - Rainforest

VQGAN-CLIP z+quantize - Rainforest

“night club”

VQGAN-CLIP z+quantize - Night Club

VQGAN-CLIP z+quantize - Night Club

VQGAN-CLIP z+quantize - Night Club

VQGAN-CLIP z+quantize - Night Club

“seascape painting”

VQGAN-CLIP z+quantize - Seascape Painting

VQGAN-CLIP z+quantize - Seascape Painting

VQGAN-CLIP z+quantize - Seascape Painting

VQGAN-CLIP z+quantize - Seascape Painting

“flowing water”

VQGAN-CLIP z+quantize - Flowing Water

VQGAN-CLIP z+quantize - Flowing Water

VQGAN-CLIP z+quantize - Flowing Water

VQGAN-CLIP z+quantize - Flowing Water


VQGAN-CLIP codebook

VQGAN-CLIP using a codebook method is also from Katherine Crowson. Source code is available here.

VQGAN-CLIP codebook seem to give very similar images for different seeds, so I have only shown two examples for each phrase.

“H R Giger”

VQGAN-CLIP codebook - H R Giger

VQGAN-CLIP codebook - H R Giger

“rainforest”

VQGAN-CLIP codebook - Rainforest

VQGAN-CLIP codebook - Rainforest

“night club”

VQGAN-CLIP codebook - Night Club

VQGAN-CLIP codebook - Night Club

“seascape painting”

VQGAN-CLIP codebook - Seascape Painting

VQGAN-CLIP codebook - Seascape Painting

“flowing water”

VQGAN-CLIP codebook - Flowing Water

VQGAN-CLIP codebook - Flowing Water


Other Text-to-Image Models?

If you know of any other available Text-to-Image systems (that are freely available and shareable) let me know.


Availability

You can follow the above links and download the Python code yourself if you are so inclined.

I do include a basic GUI front-end for these Text-to-Image generators in Visions of Chaos. As long as you have the prerequisites installed (which you would need to install to run these outside Visions of Chaos) then you can experiment with these models yourself without needing to use the command line.

Text-to-Image GUI

Jason.