Text-to-Image Summary – Part 7

This is Part 7. There is also Part 1, Part 2, Part 3, Part 4, Part 5 and Part 6.

This post continues listing the Text-to-Image scripts included with Visions of Chaos and some example outputs from each script.


Name: Multi-Perceptor VQGAN+CLIP v4
Author: Remi Durant
Original script: https://colab.research.google.com/drive/1peZ98vBihDD9A1v7JdH5VvHDUuW5tcRK
Time for 512×512 on a 3090: 2 minutes 36 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Version 4 of Remi’s Multi-Perceptor VQGAN+CLIP script.

'a bronze sculpture of a garden' Multi-Perceptor VQGAN+CLIP v4
a bronze sculpture of a garden

'a church by Tadeusz Kantor' Multi-Perceptor VQGAN+CLIP v4
a church by Tadeusz Kantor

'a color pencil sketch of a monkey hyperdetailed' Multi-Perceptor VQGAN+CLIP v4
a color pencil sketch of a monkey hyperdetailed

'a comic book panel of a lush rainforest' Multi-Perceptor VQGAN+CLIP v4
a comic book panel of a lush rainforest

'a matte painting of a witch by William Geissler' Multi-Perceptor VQGAN+CLIP v4
a matte painting of a witch by William Geissler

'a peninsula by Ei-Q CGSociety' Multi-Perceptor VQGAN+CLIP v4
a peninsula by Ei-Q CGSociety

'a surrealist sculpture of hell' Multi-Perceptor VQGAN+CLIP v4
a surrealist sculpture of hell

'an eyeball made of flowers' Multi-Perceptor VQGAN+CLIP v4
an eyeball made of flowers

'cyberpunk art of a canyon' Multi-Perceptor VQGAN+CLIP v4
cyberpunk art of a canyon

'lineart of dense woodland' Multi-Perceptor VQGAN+CLIP v4
lineart of dense woodland


Any Others I Missed?

Do you know of any other colabs and/or github Text-to-Image systems I have missed? Let me know and I will see if I can convert them to work with Visions of Chaos for a future release. If you know of any public Discords with other colabs being shared let me know too.

Jason.

Text-to-Image Summary – Part 6

This is Part 6. There is also Part 1, Part 2, Part 3, Part 4, Part 5 and Part 7.

This post continues listing the Text-to-Image scripts included with Visions of Chaos and some example outputs from each script.


Name: Augmented CLIP Guided Diffusion
Author: Peter Baylies
Original script: https://github.com/pbaylies/Augmented_CLIP
Time for 512×512 on a 3090: 1 minutes 16 seconds
Maximum resolution on a 24 GB 3090: 1664×704
Maximum resolution on an 8GB 2080: 256×256 57 seconds
Description: Another CLIP Guided Diffusion script. Fast. Gives unique textured results.

'a detailed painting of people by Nicolette Macnamara' Augmented CLIP Guided Diffusion
a detailed painting of people by Nicolette Macnamara

'a diagram of a nightmare creature made of gold' Augmented CLIP Guided Diffusion
a diagram of a nightmare creature made of gold

'a nightmare creature' Augmented CLIP Guided Diffusion
a nightmare creature

'a painting of a cabin next to a stream in a secluded forest' Augmented CLIP Guided Diffusion
a painting of a cabin next to a stream in a secluded forest

'a storybook illustration of Jabba The Hutt by Carle Hessay' Augmented CLIP Guided Diffusion
a storybook illustration of Jabba The Hutt by Carle Hessay

'a werewolf by A R Middleton Todd' Augmented CLIP Guided Diffusion
a werewolf by A R Middleton Todd

'an oil painting of Big Bird' Augmented CLIP Guided Diffusion
an oil painting of Big Bird

'Gandalf trending on pixiv' Augmented CLIP Guided Diffusion
Gandalf trending on pixiv

'Lovecraftian horror' Augmented CLIP Guided Diffusion
Lovecraftian horror

'Lovecraftian horror' Augmented CLIP Guided Diffusion
poster art of the Las Vegas strip by George Passantino


Name: Princess Generator
Author: Dango233
Original script: https://colab.research.google.com/drive/1QgH9TvQMXR3PpEGBcHnghtEcwFDXLaYE
Time for 512×512 on a 3090: 2 minutes 38 seconds
Maximum resolution on a 24 GB 3090: 1664×704
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM.
Description: The latest update to “CLIP Guided Diffusion v6” from Dango233. Can give some superb results. Worth exploring and experimenting with further.

'a cloudy sunset' Princess Generator
a cloudy sunset

'a fireplace by Jacob More' Princess Generator
a fireplace by Jacob More

'a happy alien by James Jarvaise' Princess Generator
a happy alien by James Jarvaise

'a mountain path by Stephen Pace' Princess Generator
a mountain path by Stephen Pace

'a raytraced image of a western town' Princess Generator
a raytraced image of a western town

'a teddy bear' Princess Generator
a teddy bear

'Charmander made of wood by Hua Yan' Princess Generator
Charmander made of wood by Hua Yan

'dense woodland by Marie Angel' Princess Generator
dense woodland by Marie Angel

'paranoia by Floris van Dyck' Princess Generator
paranoia by Floris van Dyck

'portrait of Princess Victoria trending on artstation' Princess Generator
portrait of Princess Victoria trending on artstation


Name: Disco Diffusion v4.1
Author: @Somnai
Original script: https://colab.research.google.com/drive/1sHfRn5Y0YKYKi1k-ifUSBFRNJ8_1sa39
Time for 512×512 on a 3090: 1 minute 57 seconds
Maximum resolution on a 24 GB 3090: 2496×1088
Maximum resolution on an 8GB 2080: 1152×512. 4 minutes 39 seconds.
Description: The latest update to Disco Diffusion. Really nice detailed outputs. Low VRAM requirments allow huge sized images. I didn’t realise I had 3 zombie themed results in this random batch.

'a bronze sculpture of a zombie' Disco Diffusion v4.1
a bronze sculpture of a zombie

'a fantasy land' Disco Diffusion v4.1
a fantasy land

'a pencil sketch of Cthulhu by Rudolf Koller' Disco Diffusion v4.1
a pencil sketch of Cthulhu by Rudolf Koller

'a pop art painting of zombies' Disco Diffusion v4.1
a pop art painting of zombies

'a portrait of a young boy by Hendrick Cornelisz. van Vliet' Disco Diffusion v4.1
a portrait of a young boy by Hendrick Cornelisz. van Vliet

'a tree by Philips Wouwerman' Disco Diffusion v4.1
a tree by Philips Wouwerman

'a western town' Disco Diffusion v4.1
a western town

'a zombie' Disco Diffusion v4.1
a zombie

'Han Solo psychedelic' Disco Diffusion v4.1
Han Solo psychedelic

'vector art of the Amazon Rainforest' Disco Diffusion v4.1
vector art of the Amazon Rainforest


Name: Hypertron v2
Author: Philipuss
Original script: https://colab.research.google.com/drive/10fa8X6EsfZfda1dfhJ_BtfPZ7Te1WGoX
Time for 512×512 on a 3090: 1 minute 57 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: 256×256 2 minutes 18 seconds
Description: Version 2 of Hypertron. More models, more flavors. Works OK. Can give the “image in a sea of purple/grey” that previous MSE based scripts suffered from. Can give good results if you let it run a large random batch overnight.

'a bronze sculpture of a spooky forest by Herb Aach' Hypertron v2
a bronze sculpture of a spooky forest by Herb Aach

'a diamond made of flowers' Hypertron v2
a diamond made of flowers

'a gouache of an android by Wu Bin' Hypertron v2
a gouache of an android by Wu Bin

'a photo of a kitchen' Hypertron v2
a photo of a kitchen

'a photorealistic painting of a cemetery' Hypertron v2
a photorealistic painting of a cemetery

'a sketch of a haunted house' Hypertron v2
a sketch of a haunted house

'a tattoo of Squirtle made of clay' Hypertron v2
a tattoo of Squirtle made of clay

'an art deco painting of a human by Nicolas Lancret 8K 3D' Hypertron v2
an art deco painting of a human by Nicolas Lancret 8K 3D

'goldfish by Elfriede Lohse-Wächtler' Hypertron v2
goldfish by Elfriede Lohse-Wächtler

'Lovecraftian horror by Aileen Eagleton' Hypertron v2
Lovecraftian horror by Aileen Eagleton


Name: CC12M Diffusion
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/1TBo4saFn1BCSfgXsmREFrUl3zSQFg6CC
Time for 512×512 on a 3090: 1 minute 48 seconds
Maximum resolution on a 24 GB 3090: 1664×704.
Maximum resolution on an 8GB 2080: 832×512 2 minutes 59 seconds
Description: Can support higher resolutions, but the coherance really falls apart with anything over 256×256. It handles multiple images at once, so these examples are 4 256×256 results.

'a beachside resort' CC12M Diffusion
a beachside resort

'a bouquet of flowers' CC12M Diffusion
a bouquet of flowers

'a castle' CC12M Diffusion
a castle

'a cemetery' CC12M Diffusion
a cemetery

'a cephalopod by Walter Stuempfig super detailed' CC12M Diffusion
a cephalopod by Walter Stuempfig super detailed

'a color pencil sketch of a bedroom super detailed' CC12M Diffusion
a color pencil sketch of a bedroom super detailed

'a kitchen' CC12M Diffusion
a kitchen

'a mountainscape' CC12M Diffusion
a mountainscape

'a nightclub' CC12M Diffusion
a nightclub

'a vast city' CC12M Diffusion
a vast city


Name: Disco Diffusion v5
Authors: @Somnai and @Gandamu
Original script: https://colab.research.google.com/github/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb
Time for 512×512 on a 3090: 2 minutes 02 seconds
Maximum resolution on a 24 GB 3090: 2496×1088
Maximum resolution on an 8GB 2080: 1152×512. 4 minutes 43 seconds.
Description: The latest update to Disco Diffusion.

'a cloudy sunset' Disco Diffusion v5
a cloudy sunset

'a crying person made of wrought iron by František Jakub Prokyš psychedelic' Disco Diffusion v5
a crying person made of wrought iron by František Jakub Prokyš psychedelic

'a flemish baroque of a school of tropical fish' Disco Diffusion v5
a flemish baroque of a school of tropical fish

'a low poly render of puppies' Disco Diffusion v5
a low poly render of puppies

'a morning landscape' Disco Diffusion v5
a morning landscape

'a mosaic of a worried man by Paul Lohse' Disco Diffusion v5
a mosaic of a worried man by Paul Lohse

'a thunder storm by Cornelis Claesz van Wieringen' Disco Diffusion v5
a thunder storm by Cornelis Claesz van Wieringen

'a tropical beach' Disco Diffusion v5
a tropical beach

'computer rendering of an evil alien 4K HD realism' Disco Diffusion v5
computer rendering of an evil alien 4K HD realism

'the human condition Flickr' Disco Diffusion v5
the human condition Flickr


Name: Disco Diffusion v5 Turbo Smooth
Authors: Chris Allen
Original script: https://colab.research.google.com/github/zippy731/disco-diffusion-turbo/blob/main/Disco_Diffusion_v5_Turbo_%5Bw_3D_animation%5D.ipynb
Time for 512×512 on a 3090: 1 minutes 14 seconds
Maximum resolution on a 24 GB 3090: 2496×1088
Maximum resolution on an 8GB 2080: 832×384. 2 minutes 21 seconds.
Description: An updated version of Disco Diffusion v5 that gives fast and smooth movie outputs.

'a black and white photo of a lush rainforest trending on Flickr' Disco Diffusion v5 Turbo Smooth
a black and white photo of a lush rainforest trending on Flickr

'a detailed matte painting of a factory' Disco Diffusion v5 Turbo Smooth
a detailed matte painting of a factory

'a hacker by Mykola Burachek' Disco Diffusion v5 Turbo Smooth
a hacker by Mykola Burachek

'a sea monster CGSociety' Disco Diffusion v5 Turbo Smooth
a sea monster CGSociety

'a surrealist painting of a happy person' Disco Diffusion v5 Turbo Smooth
a surrealist painting of a happy person

'a tardigrade by Cosmo Alexander' Disco Diffusion v5 Turbo Smooth
a tardigrade by Cosmo Alexander

'an anime drawing of an evening landscape by Daphne Fedarb photorealistic' Disco Diffusion v5 Turbo Smooth
an anime drawing of an evening landscape by Daphne Fedarb photorealistic

'an art deco painting of a happy person by John Uzzell Edwards' Disco Diffusion v5 Turbo Smooth
an art deco painting of a happy person by John Uzzell Edwards

'chalk art of a bouquet of flowers' Disco Diffusion v5 Turbo Smooth
chalk art of a bouquet of flowers

'the human condition' Disco Diffusion v5 Turbo Smooth
the human condition


Name: Augmented CLIP Guided Diffusion v2
Author: Peter Baylies
Original script: https://github.com/pbaylies/Augmented_CLIP
Time for 512×512 on a 3090: 2 minutes 48 seconds
Maximum resolution on a 24 GB 3090: 1664×704
Maximum resolution on an 8GB 2080: 512×512 4 minutes 56 seconds
Description: Updaterd version of the Augmented CLIP Guided Diffusion script.

'a bungalow 4K HD realism' Augmented CLIP Guided Diffusion v2
a bungalow 4K HD realism

'a forest fire' Augmented CLIP Guided Diffusion v2
a forest fire

'a lush rainforest CryEngine' Augmented CLIP Guided Diffusion v2
a lush rainforest CryEngine

'a painting of a kitchen by Betye Saar' Augmented CLIP Guided Diffusion v2
a painting of a kitchen by Betye Saar

'a portrait of a princess trending on artstation' Augmented CLIP Guided Diffusion v2
a portrait of a princess trending on artstation

'a spooky forest' Augmented CLIP Guided Diffusion v2
a spooky forest

'a tattoo of a zombie' Augmented CLIP Guided Diffusion v2
a tattoo of a zombie

'a werewolf by David Cooke Gibson' Augmented CLIP Guided Diffusion v2
a werewolf by David Cooke Gibson

'an oil painting of a lake' Augmented CLIP Guided Diffusion v2
an oil painting of a lake

'an ugly man' Augmented CLIP Guided Diffusion v2
an ugly man


Name: v-diffusion
Author: Katherine Crowson
Original script: https://github.com/crowsonkb/v-diffusion-pytorch
Time for 512×512 on a 3090: 3 minutes 57 seconds
Maximum resolution on a 24 GB 3090: 896×512 or 640×640.
Maximum resolution on an 8GB 2080: 128×128 1 minute 19 seconds
Description: Updated version of Velocity-Diffusion. Tends to make incoherant collage images over 256×256.

'a black and white photo of a portrait of a young girl' v-diffusion Text-to-Image
a black and white photo of a portrait of a young girl

'a cityscape by Lujo Bezeredi' v-diffusion Text-to-Image
a cityscape by Lujo Bezeredi

'a cloudy sunset' v-diffusion Text-to-Image
a cloudy sunset

'a hologram of a sad face by Josef Šíma' v-diffusion Text-to-Image
a hologram of a sad face by Josef Šíma

'a lounge room by Riad Beyrouti IMAX' v-diffusion Text-to-Image
a lounge room by Riad Beyrouti IMAX

'a mountain path' v-diffusion Text-to-Image
a mountain path

'a portrait of a young boy made of metal' v-diffusion Text-to-Image
a portrait of a young boy made of metal

'a portrait of a young girl' v-diffusion Text-to-Image
a portrait of a young girl

'a space nebula' v-diffusion Text-to-Image
a space nebula

'an acrylic painting of a mountain range' v-diffusion Text-to-Image
an acrylic painting of a mountain range


Name: GLID-3
Author: Jack Qiao
Original script: https://github.com/Jack000/glid-3
Time for 512×512 on a 3090: 35 seconds
Maximum resolution on a 24 GB 3090: 768×768.
Maximum resolution on an 8GB 2080: 512×512 50 seconds
Description: Great textures and lighting. Poor image coherency.

'a cemetery' GLID-3 Text-to-Image
a cemetery

'a drawing of a cloudy sunset' GLID-3 Text-to-Image
a drawing of a cloudy sunset

'a drawing of a human lens flare' GLID-3 Text-to-Image
a drawing of a human lens flare

'a lake' GLID-3 Text-to-Image
a lake

'a large waterfall made of silver' GLID-3 Text-to-Image
a large waterfall made of silver

'a marina' GLID-3 Text-to-Image
a marina

'a minimalist painting of a teddy bear by Johann Ludwig Bleuler' GLID-3 Text-to-Image
a minimalist painting of a teddy bear by Johann Ludwig Bleuler

'a renaissance painting of paranoia made of vines' GLID-3 Text-to-Image
a renaissance painting of paranoia made of vines

'an abbey by Cornelis Pietersz' GLID-3 Text-to-Image
an abbey by Cornelis Pietersz

'an art deco painting of a rose' GLID-3 Text-to-Image
an art deco painting of a rose


Name: Disco Diffusion v5.1
Authors: @Somnai, @Gandamu and Chris Allen
Original script: https://colab.research.google.com/github/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb
Time for 512×512 on a 3090: 2 minutes 05 seconds
Maximum resolution on a 24 GB 3090: 2496×1088
Maximum resolution on an 8GB 2080: 1152×512. 4 minutes 40 seconds.
Description: Latest version of Disco Diffusion incorporating the “Turbo” features of v5 that gives fast and smooth movie outputs.

'a flemish baroque of a sunset' Disco Diffusion v5 Turbo Smooth
a flemish baroque of a sunset

'a marsh' Disco Diffusion v5 Turbo Smooth
a marsh

'a mid-nineteenth century engraving of New York City' Disco Diffusion v5 Turbo Smooth
a mid-nineteenth century engraving of New York City

'a minimalist painting of a cephalopod' Disco Diffusion v5 Turbo Smooth
a minimalist painting of a cephalopod

'a photo of Dracula' Disco Diffusion v5 Turbo Smooth
a photo of Dracula

'a watercolor painting of a knight' Disco Diffusion v5 Turbo Smooth
a watercolor painting of a knight

'an ugly person by Samuel Colman trending on ArtStation' Disco Diffusion v5 Turbo Smooth
an ugly person by Samuel Colman trending on ArtStation

'chalk art of Gandalf' Disco Diffusion v5 Turbo Smooth
chalk art of Gandalf

'lineart of a zombie' Disco Diffusion v5 Turbo Smooth
lineart of a zombie

'the Amazon Rainforest 4K HD realism' Disco Diffusion v5 Turbo Smooth
the Amazon Rainforest 4K HD realism


Name: Latent Diffusion LAION_400M
Authors: @multimodalart
Original script: https://colab.research.google.com/github/multimodalart/latent-diffusion-notebook/blob/main/Latent_Diffusion_LAION_400M_model_text_to_image.ipynb
Time for 512×512 on a 3090: 57 seconds
Maximum resolution on a 24 GB 3090: 1152×512 or 768×768
Maximum resolution on an 8GB 2080: 256×256. 1 minute 12 seconds.
Description: A new script based on the newly trained LAION_400M moidel. Impressive results at 256×256. Loses coherency at larger sizes. These examples are 4 256×256 images of each prompt.

'a black and white photo of a nightmare creature' Latent Diffusion LAION_400M
a black and white photo of a nightmare creature

'a futuristic city' Latent Diffusion LAION_400M
a futuristic city

'a hyperrealistic painting of a queen made of flowers' Latent Diffusion LAION_400M
a hyperrealistic painting of a queen made of flowers

'a painting of a happy clown' Latent Diffusion LAION_400M
a painting of a happy clown

'a skeleton' Latent Diffusion LAION_400M
a skeleton

'a stained glass window 4K HD realism' Latent Diffusion LAION_400M
a stained glass window 4K HD realism

'a watercolor painting of a lounge room' Latent Diffusion LAION_400M
a watercolor painting of a lounge room

'an eagle' Latent Diffusion LAION_400M
an eagle

'an ultrafine detailed painting of Harry Potter' Latent Diffusion LAION_400M
an ultrafine detailed painting of Harry Potter

'vector art of a zombie by Oskar Kokoschka' Latent Diffusion LAION_400M
vector art of a zombie by Oskar Kokoschka


Name: JAX CLIP Guided Diffusion v2.7
Author: nshepperd
Original script: https://colab.research.google.com/drive/1nmtcbQsE8sTjfLJ1u3Y4d6vi9ZTAvQph
Time for 512×512 on a 3090: 2 minutes 37 seconds
Maximum resolution on a 24 GB 3090: 2496×1088
Maximum resolution on an 8GB 2080: 512×512. 3 minutes 59 seconds.
Description: ANother diffusion based script. Can give very nice high detail results.

'a Dalek made of feathers' JAX CLIP Guided Diffusion v2.7
a Dalek made of feathers

'a haunted house' JAX CLIP Guided Diffusion v2.7
a haunted house

'a picture of a chateau by Odhise Paskali' JAX CLIP Guided Diffusion v2.7
a picture of a chateau by Odhise Paskali

'a refinery' JAX CLIP Guided Diffusion v2.7
a refinery

'a studio by Allan Ramsay trending on ArtStation' JAX CLIP Guided Diffusion v2.7
a studio by Allan Ramsay trending on ArtStation

'a sunset' JAX CLIP Guided Diffusion v2.7
a sunset

'a thunder storm' JAX CLIP Guided Diffusion v2.7
a thunder storm

'a watercolor painting of a fire breathing dragon' JAX CLIP Guided Diffusion v2.7
a watercolor painting of a fire breathing dragon

'a witch made of mist' JAX CLIP Guided Diffusion v2.7
a witch made of mist

'the tropics by Thomas de Keyser' JAX CLIP Guided Diffusion v2.7
the tropics by Thomas de Keyser


Name: GLID-3-XL
Author: Jack Qiao
Original script: https://github.com/Jack000/glid-3-xl
Time for 512×512 on a 3090: 1 minute 04 seconds
Maximum resolution on a 24 GB 3090: 512×512.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM.
Description: Improved/updated version of GLID-3. Uses CLIP for better accuracy. Great textures and lighting. Poor image coherency when over 256×256.

'a demon' GLID-3-XL Text-to-Image
a demon

'a detailed matte painting of a bouquet of flowers' GLID-3-XL Text-to-Image
a detailed matte painting of a bouquet of flowers

'a kitchen' GLID-3-XL Text-to-Image
a kitchen

'a photorealistic painting of a movie monster hyperrealistic' GLID-3-XL Text-to-Image
a photorealistic painting of a movie monster hyperrealistic

'a picture of The Incredible Hulk by Kazimir Malevich' GLID-3-XL Text-to-Image
a picture of The Incredible Hulk by Kazimir Malevich

'a pop art painting of an angry woman' GLID-3-XL Text-to-Image
a pop art painting of an angry woman

'a spooky forest' GLID-3-XL Text-to-Image
a spooky forest

'an abbey' GLID-3-XL Text-to-Image
an abbey

'New York City by Marie Courtois' GLID-3-XL Text-to-Image
New York City by Marie Courtois

'poster art of Gandalf vivid colors' GLID-3-XL Text-to-Image
poster art of Gandalf vivid colors


Name: ruDALL-E Aspect Ratio
Author: Alex Shonenkov
Original script: https://github.com/shonenkov-AI/rudalle-aspect-ratio
Time for 512×512 on a 3090: N/A
Maximum resolution on a 24 GB 3090: N/A
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM.
Description: Version of ruDALL-E that generates wide and/or tall aspect ratio images. The shorter side is limited to 256 pixels. Results can be very nice. Will generate multiple images at once, so these sample images have 4 results per prompt.

'a black and white photo of a werewolf' ruDALL-E Aspect Ratio Text-to-Image
a black and white photo of a werewolf

'a cartoon of a swamp' ruDALL-E Aspect Ratio Text-to-Image
a cartoon of a swamp

'a large waterfall made of metal' ruDALL-E Aspect Ratio Text-to-Image
a large waterfall made of metal

'a lounge room' ruDALL-E Aspect Ratio Text-to-Image
a lounge room

'a matte painting of a townhouse' ruDALL-E Aspect Ratio Text-to-Image
a matte painting of a townhouse

'a palace made of mist' ruDALL-E Aspect Ratio Text-to-Image
a palace made of mist

'a photo of an ugly woman' ruDALL-E Aspect Ratio Text-to-Image
a photo of an ugly woman

'a tropical beach' ruDALL-E Aspect Ratio Text-to-Image
a tropical beach

'an evil clown' ruDALL-E Aspect Ratio Text-to-Image
an evil clown

'dense woodland' ruDALL-E Aspect Ratio Text-to-Image
dense woodland

Any Others I Missed?

Do you know of any other colabs and/or github Text-to-Image systems I have missed? Let me know and I will see if I can convert them to work with Visions of Chaos for a future release. If you know of any public Discords with other colabs being shared let me know too.

Jason.

Text-to-Image Summary – Part 5

This is Part 5. There is also Part 1, Part 2, Part 3, Part 4, Part 6 and Part 7.

This post continues listing the Text-to-Image scripts included with Visions of Chaos and some example outputs from each script.


Name: Multi-Perceptor CLIP Guided Diffusion Secondary Model Method
Author: SOMNAI
Original script: https://colab.research.google.com/drive/1Pf5F84FzWe9iAKNbiPaEo_v4hvQZ9SqS
Time for 512×512 on a 3090: 7 minutes 23 seconds
Maximum resolution on a 24 GB 3090: 1792×768 or 2048×640.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: The winner for the longest name so far. Needs tweaking as the addition of the secondary model here reduces the usual excellent quality of the Multi-Perceptor CLIP Guided Diffusion. Still shows a lot of potential.

'a 3D render of Robocop' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
a 3D render of Robocop

'a futuristic city IMAX' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
a futuristic city IMAX

'a matte painting of trypophobia' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
a matte painting of trypophobia

'a renaissance painting of a cloudy sunset trending on ArtStation' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
a renaissance painting of a cloudy sunset trending on ArtStation

'a woman 4K photo' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
a woman 4K photo

'an evil clown Flickr' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
an evil clown Flickr

'an oil painting of a nightmare creature by Louis Janmot' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
an oil painting of a nightmare creature by Louis Janmot

'Indiana Jones' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
Indiana Jones

'reflective spheres' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
reflective spheres

'zombies filmic' Multi-Perceptor CLIP Guided Diffusion Secondary Model Method Text-to-Image
zombies filmic


Name: Multi-Perceptor VQGAN+CLIP v2
Author: Remi Durant
Original script: https://colab.research.google.com/drive/1peZ98vBihDD9A1v7JdH5VvHDUuW5tcRK
Time for 512×512 on a 3090: 3 minutes 45 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Version 2 of Remi’s Multi-Perceptor VQGAN+CLIP script.

'a babbling brook by Zhou Wenjing' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a babbling brook by Zhou Wenjing

'a bedroom by Francesco Furini' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a bedroom by Francesco Furini

'a computer by Édouard Detaille' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a computer by Édouard Detaille

'a cross stitch of a landscape vivid colors' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a cross stitch of a landscape vivid colors

'a kitchen filmic' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a kitchen filmic

'a matte painting of halloween' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a matte painting of halloween

'a pastel of a peacock' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a pastel of a peacock

'a storybook illustration of a kitchen by Lena Alexander' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
a storybook illustration of a kitchen by Lena Alexander

'an oil on canvas painting of a zombie made of voxels' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
an oil on canvas painting of a zombie made of voxels

'vector art of Darth Vader' Multi-Perceptor VQGAN+CLIP v2 Text-to-Image
vector art of Darth Vader


Name: 360Diffusion
Author: @sadly_existent
Original script: https://colab.research.google.com/github/sadnow/360Diffusion/blob/main/360Diffusion_Public.ipynb
Time for 512×512 on a 3090: 2 minutes 50 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: 256×256 2 minutes 28 seconds
Description: A new diffusion based script. Capable of some interesting results

'a bronze sculpture of a crying person by Auguste BaudBovy' 360Diffusion Text-to-Image
a bronze sculpture of a crying person by Auguste BaudBovy

'a flemish baroque of a bouquet of flowers' 360Diffusion Text-to-Image
a flemish baroque of a bouquet of flowers

'a haunted house trending on ArtStation' 360Diffusion Text-to-Image
a haunted house trending on ArtStation

'a hyperrealistic painting of trypophobia by Xia Gui' 360Diffusion Text-to-Image
a hyperrealistic painting of trypophobia by Xia Gui

'a nightmare creature' 360Diffusion Text-to-Image
a nightmare creature

'a space nebula rendered in Cinema4D' 360Diffusion Text-to-Image
a space nebula rendered in Cinema4D

'a tentacle monster 4K HD realism' 360Diffusion Text-to-Image
a tentacle monster 4K HD realism

'an oil on canvas painting of Danny Trejo by Pablo Rey' 360Diffusion Text-to-Image
an oil on canvas painting of Danny Trejo by Pablo Rey

'Frankenstein' 360Diffusion Text-to-Image
Frankenstein

'heaven 8K 3D' 360Diffusion Text-to-Image
heaven 8K 3D


Name: Multi-Perceptor VQGAN+CLIP v3
Author: Remi Durant
Original script: https://colab.research.google.com/drive/1peZ98vBihDD9A1v7JdH5VvHDUuW5tcRK
Time for 512×512 on a 3090: 3 minutes 38 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Version 3 of Remi’s Multi-Perceptor VQGAN+CLIP script.

'a bronze sculpture of Gandalf' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
a bronze sculpture of Gandalf

'a clown made of clay' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
a clown made of clay

'a detailed painting of a desert oasis' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
a detailed painting of a desert oasis

'a house by Kathleen Guthrie' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
a house by Kathleen Guthrie

'a peacock made of metal' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
a peacock made of metal

'a tilt shift photo of the Las Vegas strip' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
a tilt shift photo of the Las Vegas strip

'a watercolor painting of reflective spheres 8K 3D' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
a watercolor painting of reflective spheres 8K 3D

'an art deco painting of an amusement park' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
an art deco painting of an amusement park

'lineart of Big Bird by Alesso Baldovinetti' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
lineart of Big Bird by Alesso Baldovinetti

'vector art of a forest fire' Multi-Perceptor VQGAN+CLIP v3 Text-to-Image
vector art of a forest fire


Name: FuseDream
Author: Xingchao Liu et al
Original script: https://github.com/gnobitab/FuseDream
Time for 512×512 on a 3090: 3 minutes 38 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Gives some unique outputs compared to all the previous scripts.

'a clown' FuseDream Text-to-Image
a clown

'a king' FuseDream Text-to-Image
a king

'a matte painting of New York City by Robin Guthrie' FuseDream Text-to-Image
a matte painting of New York City by Robin Guthrie

'a portrait of a young girl' FuseDream Text-to-Image
a portrait of a young girl

'a rough seascape' FuseDream Text-to-Image
a rough seascape

'a sea monster' FuseDream Text-to-Image
a sea monster

'a teddy bear' FuseDream Text-to-Image
a teddy bear

'a werewolf' FuseDream Text-to-Image
a werewolf

'an airbrush painting of an angry woman' FuseDream Text-to-Image
an airbrush painting of an angry woman

'an attractive woman' FuseDream Text-to-Image
an attractive woman


Name: Looking Glass
Author: bearsharktopus
Original script: https://colab.research.google.com/drive/11vdS9dpcZz2Q2efkOjcwyax4oob6N40G
Time for 265×256 on a 3090: 1 minute 19 seconds
Maximum resolution on a 24 GB 3090: Locked to 256×256.
Maximum resolution on an 8GB 2080: 256×256 2 minutes 03 seconds
Description: A variation on ruDALL-E that added support for training the output with a single image or directory of images. It does seem to create better results than the raw ruDALL-E scripts (starting from a single image of random Perlin noise).

'a cemetery trending on pixiv' Looking Glass Text-to-Image
a cemetery trending on pixiv

'a colorful parrot' Looking Glass Text-to-Image
a colorful parrot

'a photo of a house' Looking Glass Text-to-Image
a photo of a house

'a rough seascape' Looking Glass Text-to-Image
a rough seascape

'an alien city' Looking Glass Text-to-Image
an alien city

'an angry person by Eric Auld' Looking Glass Text-to-Image
an angry person by Eric Auld

'an angry woman' Looking Glass Text-to-Image
an angry woman

'an ugly woman' Looking Glass Text-to-Image
an ugly woman

'monkeys' Looking Glass Text-to-Image
monkeys

'Yoda' Looking Glass Text-to-Image
Yoda


Name: Velocity Diffusion
Author: Katherine Crowson
Original script: https://github.com/crowsonkb/v-diffusion-pytorch
Time for 512×512 on a 3090: 3 minutes 57 seconds
Maximum resolution on a 24 GB 3090: 896×512 or 640×640.
Maximum resolution on an 8GB 2080: 128×128 1 minute 19 seconds
Description: The latest script from Katherine Crowson. Unique results compared to her previous diffusion based scripts. Worth experimenting with further.

'a detailed matte painting of traffic' Velocity Diffusion Text-to-Image
a detailed matte painting of traffic

'a detailed painting of Jason Vorhees' Velocity Diffusion Text-to-Image
a detailed painting of Jason Vorhees

'a Ghostbuster' Velocity Diffusion Text-to-Image
a Ghostbuster

'a manga drawing of a lounge room by Yayoi Kusama' Velocity Diffusion Text-to-Image
a manga drawing of a lounge room by Yayoi Kusama

'a mountain range CryEngine' Velocity Diffusion Text-to-Image
a mountain range CryEngine

'a portrait of a young girl made of feathers rendered in unreal engine' Velocity Diffusion Text-to-Image
a portrait of a young girl made of feathers rendered in unreal engine

'a zombie' Velocity Diffusion Text-to-Image
a zombie

'lineart of a Rubiks cube' Velocity Diffusion Text-to-Image
lineart of a Rubiks cube

'The Grinch' Velocity Diffusion Text-to-Image
The Grinch

'vector art of Emporer Palpatine' Velocity Diffusion Text-to-Image
vector art of Emporer Palpatine


Name: ruDALL-E Arbitrary Resolution v1
Author: @nev
Original script: https://colab.research.google.com/drive/1DbqOIUIVBPOrJ4MeaV4YkAlb7ilWQjKZ
Time for 512×512 on a 3090: 4 minutes 40 seconds
Maximum resolution on a 24 GB 3090: 1024×1024
Maximum resolution on an 8GB 2080: 768×768 16 minutes 34 seconds
Description: Allows larger resolution images using the ruDALL-E model. Very nice results and supports larger resolutions on GPUs with less VRAM.

'a color pencil sketch of a werewolf' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a color pencil sketch of a werewolf

'a colorful parrot' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a colorful parrot

'a gorilla' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a gorilla

'a painting of a cabin next to a stream in a secluded forest' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a painting of a cabin next to a stream in a secluded forest

'a portrait of a girl with a dragon tattoo' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a portrait of a girl with a dragon tattoo

'a rose vivid colors' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a rose vivid colors

'a sketch of an ugly man' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a sketch of an ugly man

'a surrealist sculpture of a submarine' ruDALL-E Arbitrary Resolution v1 Text-to-Image
a surrealist sculpture of a submarine

'dense woodland' ruDALL-E Arbitrary Resolution v1 Text-to-Image
dense woodland

'medusa' ruDALL-E Arbitrary Resolution v1 Text-to-Image
medusa


Name: ruDALL-E Arbitrary Resolution v2
Author: @nev
Original script: https://colab.research.google.com/drive/1DbqOIUIVBPOrJ4MeaV4YkAlb7ilWQjKZ
Time for 512×512 on a 3090: 4 minutes 40 seconds
Maximum resolution on a 24 GB 3090: 1024×1024
Maximum resolution on an 8GB 2080: 768×768 15 minutes 48 seconds
Description: v2 of the ruDALL-E Arbitrary Resolution script. Allows larger resolution images using the ruDALL-E model. Very nice results and supports larger resolutions on GPUs with less VRAM.

'a bouquet of flowers' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a bouquet of flowers

'a cross stitch of a well kept garden' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a cross stitch of a well kept garden

'a futuristic city' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a futuristic city

'a large waterfall' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a large waterfall

'a minimalist painting of a castle in the mountains' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a minimalist painting of a castle in the mountains

'a photocopy of a monkey vivid colors' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a photocopy of a monkey vivid colors

'a spooky forest by Laura Muntz Lyall' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a spooky forest by Laura Muntz Lyall

'a teddy bear made of wrought iron' ruDALL-E Arbitrary Resolution v2 Text-to-Image
a teddy bear made of wrought iron

'dense woodland' ruDALL-E Arbitrary Resolution v2 Text-to-Image
dense woodland

'God' ruDALL-E Arbitrary Resolution v2 Text-to-Image
God


Name: GLIDE
Author: Unknown
Original script: https://colab.research.google.com/github/openai/glide-text2im/blob/main/notebooks/text2im.ipynb
Time for 256×256 on a 3090: 23 seconds
Maximum resolution on a 24 GB 3090: Locked to 256×256
Maximum resolution on an 8GB 2080: Locked to 256×256
Description: Images are rendered tiny at 64×64 and then upscaled internally within the script to 256×256 for ouput. The model has been “trimmed” so it cannot do anything human related and only does well for subjects it knows about. Hopefully they release the full model and/or train a larger resolutioon model in the future. Nothing to get excited about yet.

'a cathedral' GLIDE Text-to-Image
a cathedral

'a color pencil sketch of a fire breathing dragon by Erwin Bowien' GLIDE Text-to-Image
a color pencil sketch of a fire breathing dragon by Erwin Bowien

'a gorilla' GLIDE Text-to-Image
a gorilla

'a library' GLIDE Text-to-Image
a library

'a mosaic of monkeys' GLIDE Text-to-Image
a mosaic of monkeys

'a painting of a cabin next to a stream in a secluded forest' GLIDE Text-to-Image
a painting of a cabin next to a stream in a secluded forest

'an elephant' GLIDE Text-to-Image
an elephant

'dinosaurs' GLIDE Text-to-Image
dinosaurs

'goldfish' GLIDE Text-to-Image
goldfish

'the Sydney Harbour Bridge lens flare' GLIDE Text-to-Image
the Sydney Harbour Bridge lens flare


Name: Disco Diffusion
Author: @Somnai
Original script: https://colab.research.google.com/drive/1bItz4NdhAPHg5-u87KcH-MmJZjK-XqHN
Time for 512×512 on a 3090: 3 minutes 18 seconds
Maximum resolution on a 24 GB 3090: 2496×1088 11 minutes 50 seconds
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Diffusion script that includes all the latest features. Capable of rendering some very nice large resolution images (it may even do better at larger sized images than smaller resolutions like these samples).

'a cute creature' Disco Diffusion Text-to-Image
a cute creature

'a detailed matte painting of a morning landscape' Disco Diffusion Text-to-Image
a detailed matte painting of a morning landscape

'a peacock made of mist by Reinier Nooms' Disco Diffusion Text-to-Image
a peacock made of mist by Reinier Nooms

'a Pokemon character by William Etty' Disco Diffusion Text-to-Image
a Pokemon character by William Etty

'a polaroid photo of an angry woman' Disco Diffusion Text-to-Image
a polaroid photo of an angry woman

'a rough seascape' Disco Diffusion Text-to-Image
a rough seascape

'a watercolor painting of a mountain path by Mark A Brennan rendered in Cinema4D' Disco Diffusion Text-to-Image
a watercolor painting of a mountain path by Mark A Brennan rendered in Cinema4D

'an attractive woman' Disco Diffusion Text-to-Image
an attractive woman

'computer rendering of a desert oasis rendered in unreal engine' Disco Diffusion Text-to-Image
computer rendering of a desert oasis rendered in unreal engine

\

'the Amazon Rainforest by Qian Du' Disco Diffusion Text-to-Image
the Amazon Rainforest by Qian Du


Name: Infinite Diffusion
Author: https://github.com/crowsonkb/v-diffusion-pytorch
Original script: https://colab.research.google.com/drive/1VJrfInU5RbciXXD_8jzY-FntFqiyj6au
Time for 512×512 on a 3090: 3 minutes 32 seconds
Maximum resolution on a 24 GB 3090: 512×512
Maximum resolution on an 8GB 2080: 256×256 3 minutes 15 seconds
Description: Diffusion basecd script. Very VRAM hungry. Renders some unique images compared to the other methods.

'cookie monster eating a cookie' Infinite Diffusion Text-to-Image
cookie monster eating a cookie

'a renaissance painting of a farm by Bernardo Strozzi' Infinite Diffusion Text-to-Image
a renaissance painting of a farm by Bernardo Strozzi

'a silk screen of God' Infinite Diffusion Text-to-Image
a silk screen of God

'a storybook illustration of a cute monster trending on pixiv' Infinite Diffusion Text-to-Image
a storybook illustration of a cute monster trending on pixiv

'a surrealist painting of Frankenstein' Infinite Diffusion Text-to-Image
a surrealist painting of Frankenstein

'a watercolor painting of Yoda' Infinite Diffusion Text-to-Image
a watercolor painting of Yoda

'a worried woman made of clay lens flare' Infinite Diffusion Text-to-Image
a worried woman made of clay lens flare

'an art deco painting of Luke Skywalker' Infinite Diffusion Text-to-Image
an art deco painting of Luke Skywalker

'an oil painting of Buzz Lightyear' Infinite Diffusion Text-to-Image
an oil painting of Buzz Lightyear

'Chewbacca' Infinite Diffusion Text-to-Image
Chewbacca


Name: minDALL-E
Author: Kakao Brain Corp
Original script: https://github.com/kakaobrain/minDALL-E
Time for 256×256 on a 3090: 1 minutes 59 seconds
Maximum resolution on a 24 GB 3090: Locked to 256×256
Maximum resolution on an 8GB 2080: 256×256 1 minute 59 seconds
Description: Another DALL-E variation script. Locked to 256×256 but can geenrate multiple images each run.

'a cozy den' minDALL-E Text-to-Image
a cozy den

'a digital painting of Chewbacca by Willem van de Velde the Elder' minDALL-E Text-to-Image
a digital painting of Chewbacca by Willem van de Velde the Elder

'a sad person' minDALL-E Text-to-Image
a sad person

'a skull' minDALL-E Text-to-Image
a skull

'a storybook illustration of a happy clown by Gwen Barnard' minDALL-E Text-to-Image
a storybook illustration of a happy clown by Gwen Barnard

'a tree by Colin Gill' minDALL-E Text-to-Image
a tree by Colin Gill

'Bugs Bunny' minDALL-E Text-to-Image
Bugs Bunny

'fireworks by Károly Lotz' minDALL-E Text-to-Image
fireworks by Károly Lotz

'The Grand Canyon' minDALL-E Text-to-Image
The Grand Canyon

'Yoda' minDALL-E Text-to-Image
Yoda


Name: ruDOLPH
Author: SBER AI
Original script: https://github.com/sberbank-ai/ru-dolph
Time for 128×128 on a 3090: 1 minutes 15 seconds
Maximum resolution on a 24 GB 3090: Locked to 128×128
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Another ruDALL-E variation script. Locked to a tiny 128×128 resolution for now until they train the larger models. These examples were 4x upscaled with Real ESRGAN.

'a castle' ruDOLPH Text-to-Image
a castle

'a colorful parrot' ruDOLPH Text-to-Image
a colorful parrot

'a fine art painting of an ugly woman' ruDOLPH Text-to-Image
a fine art painting of an ugly woman

'a kitchen' ruDOLPH Text-to-Image
a kitchen

'a pastel of spirals made of plastic' ruDOLPH Text-to-Image
a pastel of spirals made of plastic

'a photorealistic painting of a cityscape' ruDOLPH Text-to-Image
a photorealistic painting of a cityscape

'a portrait of a woman' ruDOLPH Text-to-Image
a portrait of a woman

'a sad person by Ramon Casas i CarbÃ' ruDOLPH Text-to-Image
a sad person by Ramon Casas i CarbÃ

'kittens' ruDOLPH Text-to-Image
kittens

'vector art of a woman' ruDOLPH Text-to-Image
vector art of a woman


Name: CLIP Guided Deep Image Prior
Author: Daniel Russell
Original script: https://colab.research.google.com/drive/1_oqIK8A67EgtJDdfsuJojc5ukNzirdle
Time for 512×512 on a 3090: 1 minutes 45 seconds
Maximum resolution on a 24 GB 3090: 1024×1024 or 1680×720
Maximum resolution on an 8GB 2080: 512×512 (5 minutes 7 seconds) or 640×360
Description: Interesting script that has decent coherency. If only the output was slightly sharper and the colors slightly richer it would be a winner. Still good for unique outputs that the other methods cannot achieve.

'a flemish baroque of a shrine' CLIP Guided Deep Image Prior
a flemish baroque of a shrine

'a statue of a tardigrade made of clay' CLIP Guided Deep Image Prior
a statue of a tardigrade made of clay

'a surrealist painting of a Pixar character' CLIP Guided Deep Image Prior
a surrealist painting of a Pixar character

'a surrealist painting of an evening landscape 4K photo' CLIP Guided Deep Image Prior
a surrealist painting of an evening landscape 4K photo

'an abstract sculpture of an evil clown by Han Gan' CLIP Guided Deep Image Prior
an abstract sculpture of an evil clown by Han Gan

'an ambient occlusion render of Bugs Bunny made of wood' CLIP Guided Deep Image Prior
an ambient occlusion render of Bugs Bunny made of wood

'Cookie Monster' CLIP Guided Deep Image Prior
Cookie Monster

'Jabba The Hutt by Shūbun Tenshō' CLIP Guided Deep Image Prior
Jabba The Hutt by Shūbun Tenshō

'tentacles by Johanna Marie Fosie' CLIP Guided Deep Image Prior
tentacles by Johanna Marie Fosie

'vector art of heaven' CLIP Guided Deep Image Prior
vector art of heaven


Any Others I Missed?

Do you know of any other colabs and/or github Text-to-Image systems I have missed? Let me know and I will see if I can convert them to work with Visions of Chaos for a future release. If you know of any public Discords with other colabs being shared let me know too.

Jason.

Text-to-Image Summary – Part 4

This is Part 4. There is also Part 1, Part 2, Part 3, Part 5, Part 6 and Part 7.

This post continues listing the Text-to-Image scripts included with Visions of Chaos and some example outputs from each script.


Name: PixelDraw
Author: dribnet
Original script: https://colab.research.google.com/github/dribnet/clipit/blob/master/demos/PixelDrawer.ipynb
Time for 512×512 on a 3090: 1 minutes 59 seconds
Maximum resolution on a 24 GB 3090: Huge. 4096×4096 and beyond.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Generates “pixel art” images. I had a lot of requests to add support for this one.

'a cartoon of a peacock' PixelDraw Text-to-Image
a cartoon of a peacock

'a cloudy sunset' PixelDraw Text-to-Image
a cloudy sunset

'a gorilla' PixelDraw Text-to-Image
a gorilla

'a morning landcsape' PixelDraw Text-to-Image
a morning landscape

'a watercolor painting of a castle' PixelDraw Text-to-Image
a watercolor painting of a castle

'an art deco painting of Al Pacino' PixelDraw Text-to-Image
an art deco painting of Al Pacino

'Hell' PixelDraw Text-to-Image
Hell

'Shrek' PixelDraw Text-to-Image
Shrek


Name: DirectVisions
Author: Jens Goldberg
Original script: https://colab.research.google.com/drive/127lKSsQjx-UDDUSvIkLL6mREfZ0KQu5D
Time for 512×512 on a 3090: 2 minutes 39 seconds
Maximum resolution on a 24 GB 3090: Huge. 4096×4096 and beyond.
Maximum resolution on an 8GB 2080: 4096×4096
Description: Interesting detailed images. Can create huge resolution results.

'a color pencil sketch of a western town' DirectVisions Text-to-Image
a color pencil sketch of a western town

'a detailed painting of a cephalopod' DirectVisions Text-to-Image
a detailed painting of a cephalopod

'a digital rendering of an ugly face' DirectVisions Text-to-Image
a digital rendering of an ugly face

'a pencil sketch of Buzz Lightyear' DirectVisions Text-to-Image
a pencil sketch of Buzz Lightyear

'a rough seascape by Pinchus Kremegne' DirectVisions Text-to-Image
a rough seascape by Pinchus Kremegne

'a stock photo of a president' DirectVisions Text-to-Image
a stock photo of a president

'a sunset' DirectVisions Text-to-Image
a sunset

'an alien city' DirectVisions Text-to-Image
an alien city

'an alien forest by Helen Berman' DirectVisions Text-to-Image
an alien forest by Helen Berman

'an evening landscape' DirectVisions Text-to-Image
an evening landscape


Name: Pixel Direct
Author: Unknown
Original script: https://colab.research.google.com/drive/1F9ZOZnpV3uBPRDSESaAXYwzNZJQRJT75
Time for 512×512 on a 3090: 1 minutes 03 seconds
Maximum resolution on a 24 GB 3090: Huge. 4096×4096 and beyond.
Maximum resolution on an 8GB 2080: 2048×2048 1 minute 51 seconds
Description: Another “Pixel Art” script. More abstract results than the PixelDraw script above.

'a bronze sculpture of a nightmare creature' Pixel Direct Text-to-Image
a bronze sculpture of a nightmare creature

'a cartoon of Al Pacino' Pixel Direct Text-to-Image
a cartoon of Al Pacino

'a nightclub' Pixel Direct Text-to-Image
a nightclub

'a silk screen of a bouquet of flowers' Pixel Direct Text-to-Image
a silk screen of a bouquet of flowers

'an etching of a worried woman' Pixel Direct Text-to-Image
an etching of a worried woman

'an illustration of of a thunder storm' Pixel Direct Text-to-Image
an illustration of of a thunder storm


Name: FourierVisions
Author: Unknown
Original script: https://colab.research.google.com/drive/1nGNBjhbYnDHSumGPjpFHjDOsaZFAqGgF
Time for 512×512 on a 3090: 1 minutes 40 seconds
Maximum resolution on a 24 GB 3090: Huge. 4096×4096 and beyond.
Maximum resolution on an 8GB 2080: 1024×1024 4 minutes 07 seconds
Description: Detailed images. The default script generates washed out pastel images, but with some gamma and brightness tweaks they can be improved (still not ideal, but better). Allows very large resolution images.

'a cathedral' FourierVisions Text-to-Image
a cathedral

'a charcoal drawing of zombies' FourierVisions Text-to-Image
a charcoal drawing of zombies

'a detailed painting of a sunset by Thomas Cantrell Dugdale' FourierVisions Text-to-Image
a detailed painting of a sunset by Thomas Cantrell Dugdale

'a ghost made of mist' FourierVisions Text-to-Image
a ghost made of mist

'a kitchen' FourierVisions Text-to-Image
a kitchen

'a movie monster' FourierVisions Text-to-Image
a movie monster

'a pencil sketch of a sad clown' FourierVisions Text-to-Image
a pencil sketch of a sad clown

'a werewolf' FourierVisions Text-to-Image
a werewolf

'an evil clown by Viktor Oliva' FourierVisions Text-to-Image
an evil clown by Viktor Oliva

'an ink drawing of an ugly monster' FourierVisions Text-to-Image
an ink drawing of an ugly monster


Name: PyramidVisions
Author: Unknown
Original script: https://colab.research.google.com/drive/1dpAS_wK34y7c6s-CatAFmBtbkjGT_erM
Time for 512×512 on a 3090: 3 minutes 08 seconds
Maximum resolution on a 24 GB 3090: Huge. 4096×4096 and beyond.
Maximum resolution on an 8GB 2080: 1024×1024 10 minutes 48 seconds
Description: Very detailed images. Not the fastest script, but gives some very nice results. Lower VRAM requirements so good for lesser spec GPUs. Definitely one of the better scripts worth exploring.

'a desert oasis' PyramidVisions Text-to-Image
a desert oasis

'a lush rainforest' PyramidVisions Text-to-Image
a lush rainforest

'a marble sculpture of an angry person' PyramidVisions Text-to-Image
a marble sculpture of an angry person

'a minimalist painting of the Amazon Rainforest' PyramidVisions Text-to-Image
a minimalist painting of the Amazon Rainforest

'a nightmare creature' PyramidVisions Text-to-Image
a nightmare creature

'a pastel of a computer made of paper' PyramidVisions Text-to-Image
a pastel of a computer made of paper

'an abstract sculpture of a sad clown' PyramidVisions Text-to-Image
an abstract sculpture of a sad clown

'an acrylic painting of an alien forest | vivid colors' PyramidVisions Text-to-Image
an acrylic painting of an alien forest | vivid colors

'Medusa' PyramidVisions Text-to-Image
Medusa

'vector art of an ugly woman' PyramidVisions Text-to-Image
vector art of an ugly woman


Name: Visions of AI v1
Author: Jason Rampe
Original script: Included with Visions of Chaos. No colab.
Time for 512×512 on a 3090: 1 minutes 32 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480.
Maximum resolution on an 8GB 2080: 256×256 1 minute 33 seconds
Description: My first attempt at actually creating a Text-to-Image script. Based on the excellent example from Jonathan Whitaker‘s AIAIArt Lesson 3 tutorial. Gives some very nice fine detail in some areas, but suffers the non coherance of other scripts in that it creates multiple copies of the subject throughout the image. After actually trying to write my own script I only have more respect for those who can do this. Hopefully I can improve these results for a version 2. In the meantime, here are some sample from the current Visions of AI script.

'a cartoon of the human condition by Judy Takács' Visions of AI Text-to-Image
a cartoon of the human condition by Judy Takács

'a cubist painting of an evening landscape' Visions of AI Text-to-Image
a cubist painting of an evening landscape

'a digital rendering of frogs' Visions of AI Text-to-Image
a digital rendering of frogs

'a fire breathing dragon' Visions of AI Text-to-Image
a fire breathing dragon

'a hyperrealistic painting of a movie monster' Visions of AI Text-to-Image
a hyperrealistic painting of a movie monster

'a morning landscape' Visions of AI Text-to-Image
a morning landscape

'a shark' Visions of AI Text-to-Image
a shark

'a woodcut of an ugly man' Visions of AI Text-to-Image
a woodcut of an ugly man

'an airbrush painting of C-3PO' Visions of AI Text-to-Image
an airbrush painting of C-3PO

'Frankenstein' Visions of AI Text-to-Image
Frankenstein


Name: Visions of AI v2
Author: Jason Rampe
Original script: Included with Visions of Chaos. No colab.
Time for 512×512 on a 3090: 2 minutes 35 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480.
Maximum resolution on an 8GB 2080: 256×256 2 minutes 36 seconds
Description: An attempt to improve the coherency of the previous script. The first 30 iterations zoom into the image every 10 frames. This results in larger shapes/blobs for the rest of the script to work from. The idea is that it will give larger subjects compared to the v1 script. Kind of works. Gives blurrier results. To be fixed in the next version?

'a morning landscape by William Gear' Visions of AI v2 Text-to-Image
a morning landscape by William Gear

'a raytraced image of a nightclub lens flare' Visions of AI v2 Text-to-Image
a raytraced image of a nightclub lens flare

'a tentacle monster by Carlo Crivelli' Visions of AI v2 Text-to-Image
a tentacle monster by Carlo Crivelli

'a woodcut of a worried woman by Li Keran' Visions of AI v2 Text-to-Image
a woodcut of a worried woman by Li Keran

'an illustration of of a cave made of cheese' Visions of AI v2 Text-to-Image
an illustration of of a cave made of cheese

'Cthulhu' Visions of AI v2 Text-to-Image
Cthulhu

'cyberpunk art of a futuristic city' Visions of AI v2 Text-to-Image
cyberpunk art of a futuristic city

'goldfish' Visions of AI v2 Text-to-Image
goldfish

'reflective spheres' Visions of AI v2 Text-to-Image
reflective spheres

'the Australian outback' Visions of AI v2 Text-to-Image
the Australian outback


Name: Multi-Perceptor CLIP Guided Diffusion
Author: Varkarrus
Original script: https://colab.research.google.com/drive/1y3Vt39A5KSNFRa6Z2bCqDHxteZSVH9NC
Time for 512×512 on a 3090: 3 minutes 08 seconds
Maximum resolution on a 24 GB 3090: 896×512 or 1152×384 (dimensions must be divisible by 128).
Maximum resolution on an 8GB 2080: 128×128 1 minute 56 seconds
Description: Builds upon previous CLIP Guided Diffusion scripts. Like the previous script by Dango233 it uses three CLIP models simultaneously to “rate” the generated images, and I have added options to use up to six different CLIP models. The resulting image accuracy compared to the prompt, and the resulting image coherence seem to be much better than previous CLIP Guided Diffusion scripts that could almost have random outputs sometimes. This script is superb and highly recommended. Great lighting, textures and brushstrokes. Normally with these blog posts I do a batch run of random prompts overnight and then pick the best 10 images. In this case I had nearly 50 images in my “good” folder after going through the batch results. So, for this script I am showing 20 sample images.

'a cute creature | TriX 400 TX' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a cute creature | TriX 400 TX

'a digital painting of Frankenstein by Kanzan Shimomura' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a digital painting of Frankenstein by Kanzan Shimomura

'a morning landscape by János SaxonSzász' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a morning landscape by János SaxonSzász

'a nightmare creature' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a nightmare creature

'a photorealistic painting of a teddy bear' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a photorealistic painting of a teddy bear

'a portrait of a young girl' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a portrait of a young girl

'a space nebula | IMAX' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a space nebula | IMAX

'a worried man' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a worried man

'a zombie by Nathaniel Hone' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
a zombie by Nathaniel Hone

'an acrylic painting of a spider by Abram Arkhipov' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
an acrylic painting of a spider by Abram Arkhipov

'an airbrush painting of a monkey by Jeremy Henderson' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
an airbrush painting of a monkey by Jeremy Henderson

'an alien landscape' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
an alien landscape

'an ugly creature made of insects' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
an ugly creature made of insects

'an ultrafine detailed painting of a sad person | ZBrush' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
an ultrafine detailed painting of a sad person | ZBrush

'Arnold Schwarzenegger | trending on ArtStation' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
Arnold Schwarzenegger | trending on ArtStation

'concept art of Robocop' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
concept art of Robocop

'dinosaurs' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
dinosaurs

'Dracula | CGSociety' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
Dracula | CGSociety

'flesh made of insects' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
flesh made of insects

'God by William Simpson' Multi-Perceptor CLIP Guided Diffusion Text-to-Image
God by William Simpson


Name: Pixel MultiColors
Author: Remi Durant
Original script: https://colab.research.google.com/drive/17c-13cl_VQKpHq2rDrnFVi6ZT-CHeZNn
Time for 512×512 on a 3090: 0 minutes 44 seconds
Maximum resolution on a 24 GB 3090: 4096×4096.
Maximum resolution on an 8GB 2080: 2048×2048 7 minutes 45 seconds
Description: Very noisy/pixelated/abstract results. The default script gives dark images which some tweaks to brightness and contrast can help. Maybe a little bit of blur could help too in a future revision. It is fast though, and can support huge image sizes.

'a charcoal drawing of a cute creature made of metal' Pixel MultiColors Text-to-Image
a charcoal drawing of a cute creature made of metal

'a farm' Pixel MultiColors Text-to-Image
a farm

'a forest path by Walter Leighton Clark' Pixel MultiColors Text-to-Image
a forest path by Walter Leighton Clark

'a lighthouse' Pixel MultiColors Text-to-Image
a lighthouse

'a surrealist painting of a beachside resort' Pixel MultiColors Text-to-Image
a surrealist painting of a beachside resort

'a well kept garden' Pixel MultiColors Text-to-Image
a well kept garden

'an abstract sculpture of Pikachu' Pixel MultiColors Text-to-Image
an abstract sculpture of Pikachu

'an art deco painting of a volcano' Pixel MultiColors Text-to-Image
an art deco painting of a volcano

'an ink drawing of tentacles' Pixel MultiColors Text-to-Image
an ink drawing of tentacles

'an octopus Rendered in Cinema4D' Pixel MultiColors Text-to-Image
an octopus Rendered in Cinema4D


Name: Ultraquick CLIP Guided Diffusion
Author: @sadly_existent
Original script: https://colab.research.google.com/github/sadnow/360Diffusion/blob/main/360Diffusion_AlphaTesting.ipynb
Time for 512×512 on a 3090: 1 minute 57 seconds
Maximum resolution on a 24 GB 3090: Locked to either 256×256 or 512×512.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Another CLIP Guided Diffusion script. Can give some interesting results.

'a cave' Pixel MultiColors Text-to-Image
a cave

'a color pencil sketch of Cthulhu' Pixel MultiColors Text-to-Image
a color pencil sketch of Cthulhu

'a detailed painting of Shrek' Pixel MultiColors Text-to-Image
a detailed painting of Shrek

'a flemish baroque of the human condition by George Barret Jr' Pixel MultiColors Text-to-Image
a flemish baroque of the human condition by George Barret Jr

'a low poly render of halloween' Pixel MultiColors Text-to-Image
a low poly render of halloween

'a photorealistic painting of a worried woman made of paper by Ann Thetis Blacker' Pixel MultiColors Text-to-Image
a photorealistic painting of a worried woman made of paper by Ann Thetis Blacker

'a surrealist painting of a worried man' Pixel MultiColors Text-to-Image
a surrealist painting of a worried man

'a surrealist sculpture of an angry man 8K 3D' Pixel MultiColors Text-to-Image
a surrealist sculpture of an angry man 8K 3D

'Robocop' Pixel MultiColors Text-to-Image
Robocop

'zombies' Pixel MultiColors Text-to-Image
zombies


Name: ruDALL-E
Author: @sadly_existent
Original script: https://colab.research.google.com/drive/1wGE-046et27oHvNlBNPH07qrEQNE04PQ
Optimized script: https://colab.research.google.com/drive/1euIMG8E6kSFA2nU58LqrVsq6nbXjqELY
Time for 256×256 on a 3090: 1 minute 05 seconds
Maximum resolution on a 24 GB 3090: Locked to 256×256.
Maximum resolution on an 8GB 2080: Cannot run on 8GB VRAM
Description: Russian version of DALL-E. Only takes text prompts in Russian, so I do some auto English to Russian translations. Locked to small 256×256 images at this stage, but can create some interesting results.

'a hyperrealistic painting of Chewbacca by Edith Grace Wheatley' ruDALL-E Text-to-Image
a hyperrealistic painting of Chewbacca by Edith Grace Wheatley

'a low poly render of Pikachu' ruDALL-E Text-to-Image
a low poly render of Pikachu

'a man' ruDALL-E Text-to-Image
a man

'a rose' ruDALL-E Text-to-Image
a rose

'a stock photo of puppies' ruDALL-E Text-to-Image
a stock photo of puppies

'egyptian art of a portrait of a woman' ruDALL-E Text-to-Image
egyptian art of a portrait of a woman

'Harry Potter' ruDALL-E Text-to-Image
Harry Potter

'Indiana Jones' ruDALL-E Text-to-Image
Indiana Jones

'Robocop made of gold' ruDALL-E Text-to-Image
Robocop made of gold

'Yoda' ruDALL-E Text-to-Image
Yoda


Name: ruVQGAN+CLIP
Author: nev
Original script: https://colab.research.google.com/drive/1wAnIHocDYFAbWtA7rk8C7cFEUdRyLzwZ
Time for 512×512 on a 3090: 1 minute 28 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: 256×256 1 minute 27 seconds
Description: Creates fairly blurry results. Even with post process sharpening. If anyone could get these results crisper it would be really improve the output.

'a 3D render of a wizard by Gertrude Greene' ruVQGAN+CLIP Text-to-Image
a 3D render of a wizard by Gertrude Greene

'a cubist painting of a Pokemon character' ruVQGAN+CLIP Text-to-Image
a cubist painting of a Pokemon character

'a cute creature' ruVQGAN+CLIP Text-to-Image
a cute creature

'a matte painting of halloween by Carlos Trillo Name' ruVQGAN+CLIP Text-to-Image
a matte painting of halloween by Carlos Trillo Name

'a photorealistic painting of an alien landscape by Jacob Ochtervelt' ruVQGAN+CLIP Text-to-Image
a photorealistic painting of an alien landscape by Jacob Ochtervelt

'a rough seascape filmic' ruVQGAN+CLIP Text-to-Image
a rough seascape filmic

'a sea monster' ruVQGAN+CLIP Text-to-Image
a sea monster

'a woodcut of a skull by Gu Hongzhong trending on ArtStation' ruVQGAN+CLIP Text-to-Image
a woodcut of a skull by Gu Hongzhong trending on ArtStation

'Cthulhu' ruVQGAN+CLIP Text-to-Image
Cthulhu

'trypophobia' ruVQGAN+CLIP Text-to-Image
trypophobia


Name: Multi-Perceptor VQGAN+CLIP
Author: Remi Durant
Original script: https://colab.research.google.com/drive/1peZ98vBihDD9A1v7JdH5VvHDUuW5tcRK
Time for 512×512 on a 3090: 2 minute 30 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: As with the previous Multi-Perceptor CLIP Guided Diffusion scripts this one allows two different CLIP models to be used to rate the VQGAN output images. VQGAN is not going to beat diffusion for image coherance, but this script can give some very nice lighting and fine details in images.

'a bronze sculpture of an evil clown made of clay by Dionisio Baixeras Verdaguer' Multi-Perceptor VQGAN+CLIP Text-to-Image
a bronze sculpture of an evil clown made of clay by Dionisio Baixeras Verdaguer

'a fantasy land by Shigeru Aoki' Multi-Perceptor VQGAN+CLIP Text-to-Image
a fantasy land by Shigeru Aoki

'a hyperrealistic painting of puppies' Multi-Perceptor VQGAN+CLIP Text-to-Image
a hyperrealistic painting of puppies

'a midnineteenth century engraving of the Sydney Opera House' Multi-Perceptor VQGAN+CLIP Text-to-Image
a midnineteenth century engraving of the Sydney Opera House

'a statue of reflective spheres' Multi-Perceptor VQGAN+CLIP Text-to-Image
a statue of reflective spheres

'a surrealist painting of a tropical beach' Multi-Perceptor VQGAN+CLIP Text-to-Image
a surrealist painting of a tropical beach

'an alien city CGSociety' Multi-Perceptor VQGAN+CLIP Text-to-Image
an alien city CGSociety

'an oil painting of a fire breathing dragon' Multi-Perceptor VQGAN+CLIP Text-to-Image
an oil painting of a fire breathing dragon

'computer rendering of a well kept garden by Norman Garstin ZBrush' Multi-Perceptor VQGAN+CLIP Text-to-Image
computer rendering of a well kept garden by Norman Garstin ZBrush

'war CryEngine' Multi-Perceptor VQGAN+CLIP Text-to-Image
war CryEngine


Name: Hypertron
Author: Philipuss
Original script: https://colab.research.google.com/drive/10fa8X6EsfZfda1dfhJ_BtfPZ7Te1WGoX
Time for 512×512 on a 3090: 2 minute 00 seconds
Maximum resolution on a 24 GB 3090: 1120×480.
Maximum resolution on an 8GB 2080: 256×256 1 minute 35 seconds
Description: Another VQGAN based script. Has various “flavors” to give different results. Works OK. Can give the “image in a sea of purple/grey” that previous MSE based scripts suffered from. Still worth a try.

'a black and white photo of a fireman' Hypertron Text-to-Image
a black and white photo of a fireman

'a cute monster by Józef Mehoffer' Hypertron Text-to-Image
a cute monster by Józef Mehoffer

'a matte painting of a forest clearing' Hypertron Text-to-Image
a matte painting of a forest clearing

'a pop art painting of a human' Hypertron Text-to-Image
a pop art painting of a human

'a renaissance painting of a ghost by Jan van de Cappelle film' Hypertron Text-to-Image
a renaissance painting of a ghost by Jan van de Cappelle film

'a sea monster made of metal' Hypertron Text-to-Image
a sea monster made of metal

'a tattoo of a zombie' Hypertron Text-to-Image
a tattoo of a zombie

'a watercolor painting of a dragon Flickr' Hypertron Text-to-Image
a watercolor painting of a dragon Flickr

'an art deco painting of a haunted house by Mary Cameron' Hypertron Text-to-Image
an art deco painting of a haunted house by Mary Cameron

'concept art of a mountainscape by Maximilian Cercha' Hypertron Text-to-Image
concept art of a mountainscape by Maximilian Cercha


Name: CLIP Guided Diffusion Secondary Model Method
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/1mpkrhOjoyzPeSWy2r7T8EYRaU7amYOOi
Time for 512×512 on a 3090: 2 minute 28 seconds
Maximum resolution on a 24 GB 3090: 1792×768 or 2048×640.
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: A new diffusion based script from Katherine Crowson including a new “secondary model” she trained. Capable of some unique results with good textures and lighting.

'a detailed painting of Fozzy Bear by LeConte Stewart' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a detailed painting of Fozzy Bear by LeConte Stewart

'a flemish baroque of a happy person trending on pixiv' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a flemish baroque of a happy person trending on pixiv

'a flock of birds' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a flock of birds

'a Ghostbuster CGSociety' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a Ghostbuster CGSociety

'a kitchen made of cheese' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a kitchen made of cheese

'a nightmare creature' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a nightmare creature

'a photorealistic painting of The Grinch' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a photorealistic painting of The Grinch

'a portrait of a woman' CLIP Guided Diffusion Secondary Model Method Text-to-Image
a portrait of a woman

'an art deco painting of a sad clown' CLIP Guided Diffusion Secondary Model Method Text-to-Image
an art deco painting of a sad clown

'an oil painting of a nightmare' CLIP Guided Diffusion Secondary Model Method Text-to-Image
an oil painting of a nightmare



Any Others I Missed?

Do you know of any other colabs and/or github Text-to-Image systems I have missed? Let me know and I will see if I can convert them to work with Visions of Chaos for a future release. If you know of any public Discords with other colabs being shared let me know too.

Jason.

Text-to-Image Summary – Part 3

This is Part 3. There is also Part 1, Part 2, Part 4, Part 5, Part 6 and Part 7.

This post continues listing the Text-to-Image scripts included with Visions of Chaos and some example outputs from each script.


Name: CLIP Guided Diffusion v4
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/1V66mUeJbXrTuQITvJunvnWVn96FEbSI3
Time for 512×512 on a 3090: 3 minutes 05 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Another CLIP Guided Diffusion script. Locked to 512×512 resolution. Like the other CLIP Diffusion scripts, some of the results can be very detailed and interesting, but a lot of time it is hit and miss to get a result that reliably matches the input phrase. When it gets a “hit” it can create very detailed impressive results, but the amount of “misses” stops it from getting a great rating. Still worth a try if you have the patience to run a large batch of images waiting for the best results. The following samples came hand picked from a large batch run of random prompt phrases.

'a forest clearing' CLIP Guided Diffusion v4 Text-to-Image
a forest clearing

'a storybook illustration of a nightmare' CLIP Guided Diffusion v4 Text-to-Image
a storybook illustration of a nightmare

'an impressionist painting of a cemetery' CLIP Guided Diffusion v4 Text-to-Image
an impressionist painting of a cemetery

'Harry Potter in the style of Rembrandt' CLIP Guided Diffusion v4 Text-to-Image
Harry Potter in the style of Rembrandt

'a detailed painting of a witch' CLIP Guided Diffusion v4 Text-to-Image
a detailed painting of a witch

'a babbling brook' CLIP Guided Diffusion v4 Text-to-Image
a babbling brook

'a desert oasis' CLIP Guided Diffusion v4 Text-to-Image
a desert oasis

'a hyperrealistic painting of an android' CLIP Guided Diffusion v4 Text-to-Image
a hyperrealistic painting of an android

'eyeballs' CLIP Guided Diffusion v4 Text-to-Image
eyeballs

'a cross stitch of Buzz Lightyear' CLIP Guided Diffusion v4 Text-to-Image
a cross stitch of Buzz Lightyear


Name: CLIP Guided Decision Transformer
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/1V66mUeJbXrTuQITvJunvnWVn96FEbSI3
Time for 512×512 on a 3090: 1 minutes 13 seconds
Maximum resolution on a 24 GB 3090: Locked to 384×384
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Another one from Katherine Crowson. Some of the results can be very detailed and interesting, but a lot of time it is hit and miss to get a result that reliably matches the input phrase. When it gets a “hit” it can create very detailed impressive results, but the amount of “misses” stops it from getting a great rating. The following samples came hand picked from a large batch run of random prompt phrases.
Another good point for CLIP Decsision Transformer is that it will generate a batch of images from each run. So rather than a single image for the prompt text you can specify (for example) 8 images to be generated from the prompt. This allows a much larger set of images to be quickly generated to find those great outputs in.
For these images I have enhanced the resolution 4x using Real-ESRGAN (the thumnails are the original output images and the clicked images are resized x4).

a detailed painting of a palace by Thomas Kinkade
a detailed painting of a palace by Thomas Kinkade

a drawing of Chewbacca
a drawing of Chewbacca

a forest path
a forest path

a renaissance painting of a mountain range
a renaissance painting of a mountain range

a rough seascape
a rough seascape

a rough seascape
a rough seascape

a spooky forest
a spooky forest

an oil on canvas painting of a western town
an oil on canvas painting of a western town

Frankenstein
Frankenstein

The Grand Canyon
The Grand Canyon


Name: CLIPIT
Author: dribnet
Original script: https://github.com/dribnet/clipit
Time for 512×512 on a 3090: 2 minutes 38 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Another GAN+CLIP script. Gives nice results that tend to match the prompt text more closely. This one is heavy on VAM usage.

'a happy family by Piet Mondiran' CLIPIT
a happy family by Piet Mondiran

'a landscape' CLIPIT
a landscape

'a peacock' CLIPIT
a peacock

'a tropical beach by Thomas Kinkade' CLIPIT
a tropical beach by Thomas Kinkade

'a woodcut of Dracula' CLIPIT
a woodcut of Dracula

'an ambient occlusion render of a zombie' CLIPIT
an ambient occlusion render of a zombie

'eyeballs in the style of Claude Monet' CLIPIT
eyeballs in the style of Claude Monet


Name: Art Machine
Author: Hillel Wayne
Original script: https://colab.research.google.com/drive/1n_xrgKDlGQcCF6O-eL3NOd_x4NSqAUjK
Time for 512×512 on a 3090: 4 minutes 04 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 1 minute 50 seconds
Description: Another VQGAN+CLIP scipt.

'a charcoal drawing of a kitchen' Art Machine
a charcoal drawing of a kitchen

'a mosaic of a mountain path | CryEngine' Art Machine
a mosaic of a mountain path | CryEngine

'a silk screen of a tropical beach in the style of Kandinsky' Art Machine
a silk screen of a tropical beach in the style of Kandinsky

'a woodcut of a nightmare creature' Art Machine
a woodcut of a nightmare creature

'an illustration of of a mountainscape' Art Machine
an illustration of of a mountainscape

'an ultrafine detailed painting of a green tree frog as created by Craig Mullins' Art Machine
an ultrafine detailed painting of a green tree frog as created by Craig Mullins

'Dracula' Art Machine
Dracula

'Planets' Art Machine
Planets


Name: VQGAN+CLIP v5
Author: Max Woolf
Original script: https://colab.research.google.com/drive/1wkF67ThUz37T2_oPIuSwuO4e_-0vjaLs
Time for 512×512 on a 3090: 2 minutes 13 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 2 minutes 02 seconds
Description: Another VQGAN+CLIP scipt. More abstract results from this one.

'a desert oasis in the style of Salvador Dali' VQGAN+CLIP v5
a desert oasis in the style of Salvador Dali

'a hyperrealistic painting of a dragon' VQGAN+CLIP v5
a hyperrealistic painting of a dragon

'Big Bird' VQGAN+CLIP v5
Big Bird

'Cthulhu' VQGAN+CLIP v5
Cthulhu

'Robert DeNiro' VQGAN+CLIP v5
Robert DeNiro

'Yoda' VQGAN+CLIP v5
Yoda “hmmm, abstract I am”


Name: Zoetrope 5.5
Author: Bearsharktopusdev
Original script: https://colab.research.google.com/drive/1LpEbICv1mmta7Qqic1IcRTsRsq7UKRHM
Time for 512×512 on a 3090: 3 minutes 27 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×720
Maximum resolution on an 8GB 2080: 256×256 3 minutes 23 seconds
Description: Updated version of Zoetrope 5. Supports more VQGAN models, CLIP models and optimizers compared to Zoetrope 5.

'a cephalopod' Zoetrope 5.5 Text-to-Image
a cephalopod

'a flemish baroque of a demon' Zoetrope 5.5 Text-to-Image
a flemish baroque of a demon

'a photo of a submarine in the style of Vincent van Gogh' Zoetrope 5.5 Text-to-Image
a photo of a submarine in the style of Vincent van Gogh

'a snail' Zoetrope 5.5 Text-to-Image
a snail

'Cthulhu' Zoetrope 5.5 Text-to-Image
Cthulhu

'flesh' Zoetrope 5.5 Text-to-Image
flesh


Name: Zeta Quantize
Author: afiaka87
Original script: https://colab.research.google.com/gist/afiaka87/a97cca3b54c02209b94ff805224f9eb5/zeta_quantize.ipynb
Time for 512×512 on a 3090: 4 minutes 18 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×720
Maximum resolution on an 8GB 2080: 256×256 5 minutes 01 seconds
Description: Another VQGAN+CLIP scipt.

'a cute creature made of silver' Zeta Quantize
a cute creature made of silver

'a detailed painting of a cephalopod' Zeta Quantize
a detailed painting of a cephalopod

'a detailed painting of a ghost' Zeta Quantize
a detailed painting of a ghost

'a forest fire made of copper' Zeta Quantize
a forest fire made of copper

'a peacock' Zeta Quantize
a peacock

'a sketch of a Pokemon character in the style of Odilon Redon' Zeta Quantize
a sketch of a Pokemon character in the style of Odilon Redon

'a watercolor painting of dense woodland' Zeta Quantize
a watercolor painting of dense woodland


Name: Experimental VQGAN
Author: Various
Original script: https://colab.research.google.com/drive/1jx3klUxlGbYUwvtqzC9SYl4XZKHL3R81
Time for 512×512 on a 3090: 1 minutes 12 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×720
Maximum resolution on an 8GB 2080: 256×256 0 minutes 52 seconds
Description: Very nice smooth results from this one.

'a desert oasis in the style of Craig Mullins' Experimental VQGAN
a desert oasis in the style of Craig Mullins

'a dragon' Experimental VQGAN
a dragon

'a manga drawing of a happy alien' Experimental VQGAN
a manga drawing of a happy alien

'a nightmare' Experimental VQGAN
a nightmare

'a surrealist painting of love' Experimental VQGAN
a surrealist painting of love

'a watercolor painting of a lighthouse' Experimental VQGAN
a watercolor painting of a lighthouse

'an airbrush painting of a well kept garden by Piet Mondiran' Experimental VQGAN
an airbrush painting of a well kept garden by Piet Mondiran

'Cookie Monster' Experimental VQGAN
Cookie Monster


Name: SlideShowVisions
Author: Active Galaxy
Original script: https://colab.research.google.com/drive/1IihC4ZJvCh_tOgBVd900BzHX-ulPEFsa
Time for 512×512 on a 3090: 2 minutes 25 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×720
Maximum resolution on an 8GB 2080: 128×128 1 minute 56 seconds
Description: Tends to give more abstract paper cutout looks.

'a happy child' SlideShowVisions
a happy child

'a house vivid colors' SlideShowVisions
a house vivid colors

'a sea monster' SlideShowVisions
a sea monster

'a thunder storm' SlideShowVisions
a thunder storm

'a tree' SlideShowVisions
a tree

'a woodcut of war' SlideShowVisions
a woodcut of war

'an engraving of zombies' SlideShowVisions
an engraving of zombies

'Han Solo' SlideShowVisions
Han Solo


Name: Quick CLIP Guided Diffusion
Author: Daniel Russell
Original script: https://colab.research.google.com/drive/1FuOobQOmDJuG7rGsMWfQa883A9r4HxEO
Time for 512×512 on a 3090: 43 seconds
Maximum resolution on a 24 GB 3090: 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Modified version of CLIP Guided Diffusion that gets results quicker. Option for 256×256 or 512×512 sized images. Still very hit and miss when getting images that resemble the input prompt. The following samples came from a large overnight batch run of random prompts.

'a cathedral' Quick CLIP Guided Diffusion
a cathedral

'a digital painting of a space nebula' Quick CLIP Guided Diffusion
a digital painting of a space nebula

'a lounge room' Quick CLIP Guided Diffusion
a lounge room

'a monkey | lens flare' Quick CLIP Guided Diffusion
a monkey | lens flare

'a nightmare creature' Quick CLIP Guided Diffusion
a nightmare creature

'a rough seascape' Quick CLIP Guided Diffusion
a rough seascape

'a landscape' Quick CLIP Guided Diffusion
a landscape

'an android' Quick CLIP Guided Diffusion
an android

'an attractive woman' Quick CLIP Guided Diffusion
an attractive woman

'an oil on canvas painting of a cloudy sunset' Quick CLIP Guided Diffusion
an oil on canvas painting of a cloudy sunset


Name: CLIP Guided Diffusion v5
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/1QBsaDAZv8np29FPbvjffbE1eytoJcsgA
Time for 512×512 on a 3090: 3 minutes 48 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Another CLIP Guided Diffusion script. Locked to 512×512 resolution. Needs less VRAM than the previous versions. The following samples came hand picked from a large batch run of random prompt phrases.

'a cityscape' CLIP Guided Diffusion v5 Text-to-Image
a cityscape

'a gorilla' CLIP Guided Diffusion v5 Text-to-Image
a gorilla

'Cthulhu by Craig Mullins' CLIP Guided Diffusion v5 Text-to-Image
Cthulhu by Craig Mullins

'computer rendering of Emporer Palpatine made of cheese by Evan Charlton' CLIP Guided Diffusion v5 Text-to-Image
computer rendering of Emporer Palpatine made of cheese by Evan Charlton

'digital art of a mountainscape as created by Persis Goodale Thurston Taylor' CLIP Guided Diffusion v5 Text-to-Image
digital art of a mountainscape as created by Persis Goodale Thurston Taylor

'a digital rendering of Chewbacca' CLIP Guided Diffusion v5 Text-to-Image
a digital rendering of Chewbacca

'an ugly person' CLIP Guided Diffusion v5 Text-to-Image
an ugly person

See this tweet for an example of using CLIP Guided Diffusion to stylize a portrait.


Name: MSE Regulized Modified
Author: jbusted
Original script: https://colab.research.google.com/drive/1gFn9u3oPOgsNzJWEFmdK-N9h_y65b8fj
Time for 512×512 on a 3090: 3 minutes 02 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×720
Maximum resolution on an 8GB 2080: 256×256 2 minutes 45 seconds
Description: Modified and updated version of the previous “MSE Regulized VQGAN+CLIP” script. Less likely to suffer the previous script’s issue of subjects floating in a purple void.

'a bronze sculpture of a planet' MSE Regulized Modified Text-to-Image
a bronze sculpture of a planet

'a cave by Asher Brown Durand' MSE Regulized Modified Text-to-Image
a cave by Asher Brown Durand

'a charcoal drawing of Emporer Palpatine' MSE Regulized Modified Text-to-Image
a charcoal drawing of Emporer Palpatine

'a cozy den' MSE Regulized Modified Text-to-Image
a cozy den

'a detailed drawing of a heart made of string by William MacTaggart' MSE Regulized Modified Text-to-Image
a detailed drawing of a heart made of string by William MacTaggart

'a digital rendering of Arnold Schwarzenegger made of metal by Muriel Brandt' MSE Regulized Modified Text-to-Image
a digital rendering of Arnold Schwarzenegger made of metal by Muriel Brandt

'a lounge room' MSE Regulized Modified Text-to-Image
a lounge room

'a palace by Jules Joseph Lefebvre' MSE Regulized Modified Text-to-Image
a palace by Jules Joseph Lefebvre

'an oil on canvas painting of a lush rainforest' MSE Regulized Modified Text-to-Image
an oil on canvas painting of a lush rainforest

'an oil on canvas painting of Cookie Monster' MSE Regulized Modified Text-to-Image
an oil on canvas painting of Cookie Monster


Name: Pixray
Author: dribnet
Original script: https://colab.research.google.com/github/dribnet/clipit/blob/master/demos/Start_Here.ipynb
Time for 512×512 on a 3090: 1 minutes 44 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×720
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Updated version of the previous “CLIPIT” script.

'a bronze sculpture of a nightmare creature' Pixray Text-to-Image
a bronze sculpture of a nightmare creature

'a fire breathing dragon by Jan Baptist Weenix' Pixray Text-to-Image
a fire breathing dragon by Jan Baptist Weenix

'a morning landscape' Pixray Text-to-Image
a morning landscape

'a surrealist sculpture of an elephant' Pixray Text-to-Image
a surrealist sculpture of an elephant

'a watercolor painting of an astronaut' Pixray Text-to-Image
a watercolor painting of an astronaut

'an oil painting of a worried woman | Rendered in Cinema4D' Pixray Text-to-Image
an oil painting of a worried woman | Rendered in Cinema4D

'an ugly creature' Pixray Text-to-Image
an ugly creature

'Dracula' Pixray Text-to-Image
Dracula

'Frankenstein' Pixray Text-to-Image
Frankenstein

'vector art of a forest clearing' Pixray Text-to-Image
vector art of a forest clearing


Name: CLIP Guided Diffusion v6
Author: Dango233
Original script: https://colab.research.google.com/drive/14xBm1aSxQLbq26-jmDJi8I1HJ4ti5ybt
Time for 512×512 on a 3090: 3 minutes 10 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Latest CLIP Guided Diffusion script. The best one yet. Capable of some very nice results.

'a hyperrealistic painting of a human' CLIP Guided Diffusion v6 Text-to-Image
a hyperrealistic painting of a human

'a sketch of planets' CLIP Guided Diffusion v6 Text-to-Image
a sketch of planets

'a storybook illustration of a cloudy sunset' CLIP Guided Diffusion v6 Text-to-Image
a storybook illustration of a cloudy sunset

'a wizard | vivid colors' CLIP Guided Diffusion v6 Text-to-Image
a wizard | vivid colors

'an art deco sculpture of a planet' CLIP Guided Diffusion v6 Text-to-Image
an art deco sculpture of a planet

'an attractive man by John Linnell' CLIP Guided Diffusion v6 Text-to-Image
an attractive man by John Linnell

'an oil on canvas painting of satan' CLIP Guided Diffusion v6 Text-to-Image
an oil on canvas painting of satan

'an oil painting of a clown' CLIP Guided Diffusion v6 Text-to-Image
an oil painting of a clown

'digital art of an ugly person by Avigdor Arikha' CLIP Guided Diffusion v6 Text-to-Image
digital art of an ugly person by Avigdor Arikha

'princess in sanctuary trending on artstation photorealistic portrait of a young princess' CLIP Guided Diffusion v6 Text-to-Image
princess in sanctuary trending on artstation photorealistic portrait of a young princess


Name: CLIPDraw
Author: Kevin Frans
Original script: https://colab.research.google.com/github/kvfrans/clipdraw/blob/main/clipdraw.ipynb
Time for 512×512 on a 3090: 7 minutes 10 seconds
Maximum resolution on a 24 GB 3090: Huge. 4096×4096 and beyond.
Maximum resolution on an 8GB 2080: 1024×1024
Description: Generates images by a series of lines. Very abstract results.

'a cloudy sunset' CLIPDraw Text-to-Image
a cloudy sunset

'a digital painting of a rose' CLIPDraw Text-to-Image
a digital painting of a rose

'a sad clown' CLIPDraw Text-to-Image
a sad clown

'an abstract painting of Yoda' CLIPDraw Text-to-Image
an abstract painting of Yoda

'an etching of a library' CLIPDraw Text-to-Image
an etching of a library

'The Sydney Harbour Bridge' CLIPDraw Text-to-Image
The Sydney Harbour Bridge



Any Others I Missed?

Do you know of any other colabs and/or github Text-to-Image systems I have missed? Let me know and I will see if I can convert them to work with Visions of Chaos for a future release. If you know of any public Discords with other colabs being shared let me know too.

Jason.

Text-to-Image Summary – Part 2

This is Part 2. There is also Part 1, Part 3, Part 4, Part 5, Part 6 and Part 7.

This post continues listing the Text-to-Image scripts included with Visions of Chaos and some example outputs from each script.


Name: VQGAN Gumbel
Author: Eleiber
Original script: https://colab.research.google.com/drive/1tim3xTsZXafK-A2rOUsevckdl4OitIiw
Time for 512×512 on a 3090: 3 minutes 27 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 4 minutes 05 seconds
Description: Variation using the gumbel-8192 model. Results are a bit rougher than others.

'a childs drawing of a space nebula' VQGAN Gumbel Text-to-Image
a childs drawing of a space nebula

'a movie monster in the style of Edvard Munch' VQGAN Gumbel Text-to-Image
a movie monster in the style of Edvard Munch

'a raytraced image of the Amazon Rainforest' VQGAN Gumbel Text-to-Image
a raytraced image of the Amazon Rainforest

'a tropical beach in the style of Polock' VQGAN Gumbel Text-to-Image
a tropical beach in the style of Polock

'digital art of a rose' VQGAN Gumbel Text-to-Image
digital art of a rose


Name: OpenAI DVAE+CLIP
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/10DzGECHlEnL4oeqsN-FWCkIe_sq3wVqt
Time for 512×512 on a 3090: 3 minutes 07 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 2 minutes 20 seconds
Description: Results are very colorful and more abstract. By default it gives more noisy output images but this can be disabled if you prefer.

'a dragon' OpenAI DVAE+CLIP Text-to-Image
a dragon

'a hyperrealistic painting of planets' OpenAI DVAE+CLIP Text-to-Image
a hyperrealistic painting of planets

'a mountain cabin' OpenAI DVAE+CLIP Text-to-Image
a mountain cabin

'a woodcut of a mountain range in the style of Marvel Comics' OpenAI DVAE+CLIP Text-to-Image
a woodcut of a mountain range in the style of Marvel Comics

'an angry person' OpenAI DVAE+CLIP Text-to-Image
an angry person


Name: Aphantasia
Author: Vadim Epstein
Original script: https://github.com/eps696/aphantasia
Time for 512×512 on a 3090: 1 minute 5 seconds
Maximum resolution on a 24 GB 3090: 4096×4096 or 2520×1080
Maximum resolution on an 8GB 2080: 4096×4096 7 minutes 48 seconds
Description: Different and more messy pastel abstract Turneresque output. I spent a few hours trying many different combinations of settings trying to get the output more coherent and deeper colors. The following samples are as good as I could push it. I give up for now. If you can do better let me know. It does support creating larger 1280×720 resolution images on a 3090 GPU.

'a marble sculpture of a computer' Aphantasia Text-to-Image
a marble sculpture of a computer

'an eyeball' Aphantasia Text-to-Image
an eyeball

'an octopus' Aphantasia Text-to-Image
an octopus

'digital art of frogs in the style of Dr Seuss' Aphantasia Text-to-Image
digital art of frogs in the style of Dr Seuss

'medusa' Aphantasia Text-to-Image
medusa


Name: Text2Image VQGAN
Author: Vadim Epstein
Original script: https://colab.research.google.com/github/eps696/aphantasia/blob/master/CLIP_VQGAN.ipynb
Time for 512×512 on a 3090: 2 minutes 8 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 2 minutes 15 seconds
Description: Allows larger sized 480p images (854×480) on a 3090 GPU.

'a digital painting of the Las Vegas strip' Text2Image VQGAN Text-to-Image
a digital painting of the Las Vegas strip

'a midnineteenth century engraving of a cute monster' Text2Image VQGAN Text-to-Image
a midnineteenth century engraving of a cute monster

'a skeleton' Text2Image VQGAN Text-to-Image
a skeleton

'an ultrafine detailed painting of a crying person' Text2Image VQGAN Text-to-Image
an ultrafine detailed painting of a crying person

'puppies' Text2Image VQGAN Text-to-Image
puppies


Name: MSE VQGAN+CLIP z+quantize
Author: jbusted
Original script: https://colab.research.google.com/drive/1gFn9u3oPOgsNzJWEFmdK-N9h_y65b8fj
Time for 512×512 on a 3090: 6 minutes 19 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 3 minutes 36 seconds
Description: Awesome crisp results. Allows larger sized 480p images (854×480) on a 3090 GPU. One of the best scripts in this list worth exploring.

'a charcoal drawing of a country town' MSE VQGAN+CLIP z+quantize Text-to-Image
a charcoal drawing of a country town

'a hyperrealistic painting of an ugly creature' MSE VQGAN+CLIP z+quantize Text-to-Image
a hyperrealistic painting of an ugly creature

'a landscape made of mist' MSE VQGAN+CLIP z+quantize Text-to-Image
a landscape made of mist

'a mosaic of christmas' MSE VQGAN+CLIP z+quantize Text-to-Image
a mosaic of christmas

'an octopus in the style of Vincent van Gogh' MSE VQGAN+CLIP z+quantize Text-to-Image
an octopus in the style of Vincent van Gogh

MSE VQGAN+CLIP z+quantize allows specifying an image as the input starting point. If you take the output and repeatedly use it as the input with some minor image stretching each frame you can get a movie zooming into the Text-to-Image output. No blending of frames or optical flow for this one, just straight combining of the 854×480 resolution frames into a movie. The VQGAN model was “vqgan_imagenet_f16_16384” and the CLIP model was “ViT-B/32”. The prompts for this movie were “hyperrealistic homer simpson”, “hyperrealistic marge simpson”, “hyperrealistic bart simpson”, “hyperrealistic lisa simpson” and “hyperrealistic maggie simpson”. The original 480p upload was badly compressed and looked terrible after YouTube compressed it, so I upscaled the 480p to 2160p (4K) in DaVinci Resolve and reuploaded to YouTube. This caused their compression to do a better encoding job so the movie is now watchable.

This next example is how MSE VQGAN+CLIP z+quantize interprets various common human phobias. Text prompts were “a hyperrealistic painting depicting acrophobia” etc. To try and smooth out the “flickering” when zooming I started using ImageMagick for zooming. ImageMagick allows sub pixel image resizing options. This movie was also originally 480p and upsized to 4K in Davinci Resolve before uploading.

I have also added some basic scripting (as in automating a series of steps rather than a Python py script) support to Visions of Chaos. Scripting allows the prompt, zoom speed, rotation and panning to be changed during the movie with smooth interpolations between them each frame.

Text-to-Image Script GUI

The following video is a test of the scripting. This video is a Powers of Ten homage with zooming in from the largest scales to the smallest scales.

Another recent addition is the ability to use a series of images as “seed images” that are processed one at a time and then combined into a movie. The following GIF of the Alien chestburster scene is an example of this. The Text-to-Image prompt was “impasto oil painting”.

This next example movie is showing a “Self-Driven” zoom movie. As in a regular zoom movie the output frames are slightly stretched and fed back into the system each frame. The self-driven difference with this movie is that the Text-to-Image prompt text is automatically changed every 2 seconds by CLIP detecting what it “sees” in the current frame. This way the movie subjects are automatically changed and steered in new directions in a totally automated way. There is no human control except me setting the initial “Rainbow colored blobs” prompt. After that it was fully automated.

By default the CLIP Image Captioning script is very good at detecting what is in an image. Using the default accuracy resulted in a zoom movie that got stuck with a single topic or subject. One got stuck on a slight variation of a prompt dealing with kites, so as the zoom movie went deeper it only showed kites. Luckily after tweaking and decreasing the accuracy of the CLIP captioning the predicitons allow the resulting subjects to drift to new topics during the movie.


Name: Monster Maker
Author: P_Hoep
Original script: https://colab.research.google.com/drive/1ZbLnt5fLS_BDfpQY-9Dh_T40pLjfqSAC
Time for 512×512 on a 3090: 2 minutes 01 seconds
Description: No longer available. I was contacted by the author who does not want it shared publicly. The colab link no longer works.

'a black and white photo of a library in the style of Rembrandt' Monster Maker Text-to-Image
a black and white photo of a library in the style of Rembrandt

'a forest fire' Monster Maker Text-to-Image
a forest fire

'a forest path' Monster Maker Text-to-Image
a forest path

'a heart made of feathers' Monster Maker Text-to-Image
a heart made of feathers

'a surrealist painting of the Las Vegas strip' Monster Maker Text-to-Image
a surrealist painting of the Las Vegas strip


Name: CLIP Guided Diffusion
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/12a_Wrfi2_gwwAuN3VvMTwVMz9TfqctNj
Time for 256×256 on a 3090: 1 minutes 35 seconds
Maximum resolution on a 24 GB 3090: Locked to 256×256
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: This one gives very unique results compared to the other scripts. Locked to 256×256 resolution. Some of the results can be very detailed and interesting, but a lot of time it is hit and miss to get a result that reliably matches the input phrase. The following samples came hand picked from a large batch run of random phrases.

'a clown' CLIP Guided Diffusion Text-to-Image
a clown

'a hyperrealistic painting of a witch' CLIP Guided Diffusion Text-to-Image
a hyperrealistic painting of a witch

'a sea monster' CLIP Guided Diffusion Text-to-Image
a sea monster

'a surrealist sculpture of an android' CLIP Guided Diffusion Text-to-Image
a surrealist sculpture of an android

'Brad Pitt' CLIP Guided Diffusion Text-to-Image
Brad Pitt

'New York City' CLIP Guided Diffusion Text-to-Image
New York City


Name: CLIP Guided Diffusion v2
Author: afiaka87
Original script: https://colab.research.google.com/github/afiaka87/clip-guided-diffusion/blob/main/colab_clip_guided_diff_hq.ipynb
Time for 256×256 on a 3090: 2 minutes 38 seconds
Maximum resolution on a 24 GB 3090: Locked to 256×256
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
escription: Modified CLIP Guided Diffusion with more options. This one gives very unique results compared to the other scripts. Locked to 256×256 resolution. Hopefully larger resolution versions of this script will appear in the future. Some of the results can be very detailed and interesting, but a lot of time it is hit and miss to get a result that reliably matches the input phrase. The following samples came hand picked from a large batch run of random phrases.

'a digital painting of a crying person' CLIP Guided Diffusion v2 Text-to-Image
a digital painting of a crying person

'a fine art painting of heaven in the style of Edvard Munch' CLIP Guided Diffusion Text-to-Image
a fine art painting of heaven in the style of Edvard Munch

'a flemish baroque of an angry person' CLIP Guided Diffusion v2 Text-to-Image
a flemish baroque of an angry person

'a flemish baroque of hell' CLIP Guided Diffusion v2 Text-to-Image
a flemish baroque of hell

'a surrealist painting of a witch' CLIP Guided Diffusion v2 vText-to-Image
a surrealist painting of a witch

'the australian outback' CLIP Guided Diffusion v2 Text-to-Image
the australian outback


Name: CLIPRGB
Author: Jonathan Whitaker
Original script: https://colab.research.google.com/drive/1MiKaFFgau6V5QhIed5tpNdLUiSbof4nI
Time for 512×512 on a 3090: 4 minutes 51 seconds
Maximum resolution on a 24 GB 3090: 4096×4096
Maximum resolution on an 8GB 2080: 4096×4096
Description: Very early 0.1 version shows a lot of potential. Can render huge resolution images up to 4096×4096 on a 3090 so I am really looking forward to future versions of this code with sharper details.

'a digital painting of a wizard' CLIPRGB
a digital painting of a wizard

'a forest path' CLIPRGB
a forest path

'a tattoo of planets' CLIPRGB
a tattoo of planets

'a vampire' CLIPRGB
a vampire


Name: CLIP Guided Diffusion v3
Author: Michael Friesen
Original script: https://colab.research.google.com/drive/1Fl2SZvLv23MVSAHxkoiNdxPeAZwibvu1
Time for 512×512 on a 3090: 2 minutes 23 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: Modified CLIP Guided Diffusion that generates larger 512×512 images. Some of the results can be very detailed and interesting, but a lot of time it is hit and miss to get a result that reliably matches the input phrase. The following samples came hand picked from a large batch run of random phrases.

'a cubist painting of a castle' CLIP Guided Diffusion v2 Text-to-Image
a cubist painting of a castle

'a human made of vines' CLIP Guided Diffusion Text-to-Image
a human made of vines

'a rough seascape' CLIP Guided Diffusion v2 Text-to-Image
a rough seascape

'frogs' CLIP Guided Diffusion v2 Text-to-Image
frogs

'h r giger' CLIP Guided Diffusion v2 Text-to-Image
h r giger

'a matte painting of a landscape' CLIP Guided Diffusion v2 Text-to-Image
a matte painting of a landscape


Name: Zoetrope 5
Author: Bearsharktopusdev
Original script: https://colab.research.google.com/drive/1LpEbICv1mmta7Qqic1IcRTsRsq7UKRHM
Time for 512×512 on a 3090: 2 minutes 36 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1280×720
Maximum resolution on an 8GB 2080: 256×256 2 minutes 09 seconds
Description: Nice crisp results. Can generates up to 720p (1280×720) resolution images on a 3090. Includes a lot of new ideas from multiple people to help improve the outputs.

'a detailed painting of a Pixar character' Zoetrope 5 Text-to-Image
a detailed painting of a Pixar character

'a futuristic city' Zoetrope 5 Text-to-Image
a futuristic city

'a planet' Zoetrope 5 Text-to-Image
a planet

'a surrealist sculpture of a sea monster' Zoetrope 5 Text-to-Image
a surrealist sculpture of a sea monster

'an art deco scultpture of a policeman' Zoetrope 5 Text-to-Image
an art deco scultpture of a policeman

'cyberpunk art of a forest fire in the style of Edvard Munch' Zoetrope 5 Text-to-Image
cyberpunk art of a forest fire in the style of Edvard Munch


Name: CLIP RGB Optimization
Author: hotgrits
Original script: https://cdn.discordapp.com/attachments/730484623028519072/871624258260987934/CLIP__RGB_Optimization_v0_3.ipynb
Time for 512×512 on a 3090: 2 minutes 50 seconds
Maximum resolution on a 24 GB 3090: 4096×4096
Maximum resolution on an 8GB 2080: 4096×4096
Description: Another CLIP RGB based script without the pixelated artefacts of the CLIPRGB script. Can render huge resolution images up to 4096×4096 on a 3090. This script gives more impressionistic textures. By default the output was a bit too dark for my liking so I have added options to tweak the gamma and contrast of the output images in the script. The gamma and contrast tweaks are only at the display stage and do not change the internal image being generated.

'a babbling brook' CLIP RGB Optimization
a babbling brook

'a movie monster' CLIP RGB Optimization
a movie monster

'an amusement park' CLIP RGB Optimization
an amusement park

'Chewbacca' CLIP RGB Optimization
Chewbacca

'Freddy Kruger in the style of Rembrandt' CLIP RGB Optimization
Freddy Kruger in the style of Rembrandt


Name: MSE Regulized VQGAN+CLIP
Author: jbusted
Original script: https://colab.research.google.com/drive/1hf1seGOZctOJUznkhJNblLluXHbWLKZh
Time for 512×512 on a 3090: 3 minutes 16 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 128×128 2 minutes 30 seconds
Description: Generates good images but they tend to be inside a grey/purple border void.

'a bronze sculpture of a heart' MSE Regulized VQGAN+CLIP
a bronze sculpture of a heart

'a cubist painting of Buzz Lightyear' MSE Regulized VQGAN+CLIP
a cubist painting of Buzz Lightyear

'a house made of string' MSE Regulized VQGAN+CLIP
a house made of string

'an art deco sculpture of a vampire' MSE Regulized VQGAN+CLIP
an art deco sculpture of a vampire

'chalk art of C-3PO' MSE Regulized VQGAN+CLIP
chalk art of C-3PO


Name: Sequential VQGAN+CLIP
Author: Jakeukalane and Avengium
Original script: https://colab.research.google.com/drive/1CcibxlLDng2yzcjLwwwSADRcisc1qVCs
Time for 512×512 on a 3090: 1 minutes 41 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 2 minutes 11 seconds
Description: Really nice results and fast.

'a campfire in the style of Vincent van Gogh' Sequential VQGAN+CLIP
a campfire in the style of Vincent van Gogh

'a colorful parrot' Sequential VQGAN+CLIP
a colorful parrot

'a hyperrealistic painting of C-3PO' Sequential VQGAN+CLIP
a hyperrealistic painting of C-3PO

'an impressionist painting of Buzz Lightyear made of paper' Sequential VQGAN+CLIP
an impressionist painting of Buzz Lightyear made of paper

'New York City' Sequential VQGAN+CLIP
New York City


Name: CLIPRGB ImStack
Author: Jonathan Whitaker
Original script: https://colab.research.google.com/drive/1MCC2IwAaRNCTBUzghuG41ypAkxjJvGtq
Time for 512×512 on a 3090: 2 minutes 07 seconds
Maximum resolution on a 24 GB 3090: 2048×2048
Maximum resolution on an 8GB 2080: 512×512 6 minutes 21 seconds
Description: Another CLIP RGB variation. Nice results after some brightness, contrast and sharpness tweaks to the generated images. Could still be a bit sharper.

'a fine art painting of an angry person' CLIPRGB ImStack
a fine art painting of an angry person

'a fireplace in the style of Claude Monet' CLIPRGB ImStack
a fireplace in the style of Claude Monet

'a frog in the style of Beksinski' CLIPRGB ImStack
a frog in the style of Beksinski

'a nightmare creature in the style of H R Giger' CLIPRGB ImStack
a nightmare creature in the style of H R Giger

'a pointalism painting of a vampire made of copper' CLIPRGB ImStack
a pointalism painting of a vampire made of copper


Any Others I Missed?

Do you know of any other colabs and/or github Text-to-Image systems I have missed? Let me know and I will see if I can convert them to work with Visions of Chaos for a future release. If you know of any public Discords with other colabs being shared let me know too.

Jason.

Text-to-Image Summary – Part 1

This is Part 1. There is also Part 2, Part 3, Part 4, Part 5, Part 6 and Part 7.

What Are Text-to-Image Systems

Text-to-Image systems/models/scripts/networks (what is the official correct term for these?) are machine learning based models that take a descriptive phrase as input and attempt to generate images that match the input phrase.

Requirements

You do need a decent NVIDIA GPU. 3090 recommended for 768×768 resolution, 2080 for smaller 256×256 images, 10xx possibly for tiny images or if you want to try reduced settings and wait ages for results. If you have a commercial grade GPU with more memory you will be able to push these resolutions higher. VRAM matters more than GPU model, ie you can get 3090s with only 16GB of VRAM and others with 24GB. You may see a laptop with an advertised 3080 GPU, but the total VRAM will likely be much smaller than a desktop 3080. I have now updated these posts with the maximum resolution and times for a 2080 SUPER with 8GB VRAM to give people an idea of what an 8GB VRAM GPU will do.

To run these scripts from Visions of Chaos you need to have installed these prerequisites. Once you get all the prerequisites setup it really is as simple as typing your prompt text and clicking a button. I do include a lot of other settings so you can tweak the script parameters as you do more experimentation.

Text-to-Image GUI

Visions of Chaos Text-to-Image Tutorial

You can watch the following tutorial video to get an idea of how the Text-to-Image mode works in Visions of Chaos.

Text-to-Image Scripts Included With Visions of Chaos

The rest of this blog post (and other parts) lists the 91 (so far) Text-to-Image scripts that I have been able to get working with Visions of Chaos.

If you are the author of one of these scripts then many thanks to you for sharing the code publicly. If you are a creator of a script I do not include here, please leave a comment with a link or send me an email so I can try it out. If you are a better coder than I am and improve any of these also let me know and I will share your fixes with the world.

I have included sample image outputs from each script. Most of the text prompts for these samples come from a prompt builder I include with Visions of Chaos that randomly combines subjects, adjectives, styles and artists.

Note also that these samples all use the default settings for GAN and CLIP models. Most of the included scripts allow tweaking of settings and different models to alter the outputs. There is a much wider range of output images possible. Download Visions of Chaos to experiment with all the combinations of scripts, models, prompts and settings.


Name: Deep Daze
Author: Phil Wang
Original script: https://github.com/lucidrains/deep-daze
Time for 512×512 on a 3090: 1 minutes 53 seconds.
Maximum resolution on a 24 GB 3090: 1024×1024
Maximum resolution on an 8GB 2080: 256×256 1 minute 9 seconds
Description: This was the first Text-to-Image script I ever found and tested. The output images from the original script are very washed out and pastel shaded, but after adding some torchvision transforms for brightness, contrast and sharpness tweaks they are a little better. Very abstract output compared to the other scripts.

'a bronze sculpture of a colorful parrot in the style of Kandinsky' Deep Daze Text-to-Image
a bronze sculpture of a colorful parrot in the style of Kandinsky

'a crying person' Deep Daze Text-to-Image
a crying person

'a desert oasis' Deep Daze Text-to-Image
a desert oasis

'a surrealist painting of the Terminator made of silver' Deep Daze Text-to-Image
a surrealist painting of the Terminator made of silver

'a zombie in the style of Turner' Deep Daze Text-to-Image
a zombie in the style of Turner


Name: Big Sleep
Author: Phil Wang
Original script: https://github.com/lucidrains/big-sleep
Time for 512×512 on a 3090: 4 minutes 0 seconds
Maximum resolution on a 24 GB 3090: 512×512
Maximum resolution on an 8GB 2080: 512×512 6 minutes 39 seconds
Description: Can give a good variety of images for any prompt text and does not suffer from the coloring or tiled image issues some of the other methods do. See here for my older post with a lot of Big Sleep examples. If you give it a chance and run repeated batches of the same prompt you can get some very nice results.

'H R Giger' Big Sleep Text-to-Image
H R Giger

'surrealism' Big Sleep Text-to-Image
surrealism

'colorful surrealism' Big Sleep Text-to-Image
colorful surrealism

'a charcoal drawing of a landscape' Big Sleep Text-to-Image
a charcoal drawing of a landscape


Name: VQGAN+CLIP z-quantize
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/1L8oL-vLJXVcRzCFbPwOoMkPKJ8-aYdPN
Time for 512×512 on a 3090: 3 minutes 11 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 6 minutes 39 seconds
Description: The outputs tend to be divided up into rectangular regions, but the resulting imagery can be interesting.

'a drawing of a bouquet of flowers made of cardboard' VQGAN+CLIP z-quantize Text-to-Image
a drawing of a bouquet of flowers made of cardboard

'a rose made of silver' VQGAN+CLIP z-quantize Text-to-Image
a rose made of silver

'a tilt shift photo of traffic' VQGAN+CLIP z-quantize Text-to-Image
a tilt shift photo of traffic

'an abstract painting of a house made of crystals' VQGAN+CLIP z-quantize Text-to-Image
an abstract painting of a house made of crystals

'an abstract painting of a skull' VQGAN+CLIP z-quantize Text-to-Image
an abstract painting of a skull

VQGAN+CLIP z-quantize allows specifying an image as the input starting point. If you take the output, stretch it very slightly, and then feed it back into the system each frame you get a movie zooming in. For this movie I used SRCNN Super Resolution to double the resolution of the frames and then Super Slo-Mo for optical flow frame interpolation (both SRCNN and Super Slo-Mo are included with Visions of Chaos). The VQGAN model was “vqgan_imagenet_f16_16384” and the CLIP model was “ViT-B/32”. The prompts were the seven deadly sins, ie “a watercolor painting depicting pride”, “a watercolor painting depicting greed” etc.

The more astute viewers among you will notice there are only 6 of the sins in the previous video. What happened to “lust”? A while back one of my uploads was flagged as porn by the YouTube robots. Their (what I assume is) machine learning based system detected my upload as porn when there was no porn in it. An appeal was met with instant denial and so I now have a permanent “warning” on my channel with no way to talk to a person who could spend 1 minute looking at the video to tell it isn’t porn. Another warning would lead to a strike, so I am being overly cautious and omitting the lust part from the YouTube video. Those who want to see the full 7 part movie can click the following link to watch it on my LBRY channel.

https://open.lbry.com/@Softology:5/Seven-Deadly-Sins:6

Thanks LBRY!


Name: VQGAN+CLIP codebook
Author: Katherine Crowson
Original script: https://colab.research.google.com/drive/15UwYDsnNeldJFHJ9NdgYBYeo6xPmSelP
Time for 512×512 on a 3090: 3 minutes 19 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 3 minutes 46 seconds
Description: VQGAN-CLIP codebook seem to give very similar images for the same prompt phrase, so repeatedly running the script (with different seed values) does not give a wide variety of resulting images. Still gives interesting results.

'a happy alien' VQGAN+CLIP codebook Text-to-Image
a happy alien

'a library' VQGAN+CLIP codebook Text-to-Image
a library

'a teddy bear' VQGAN+CLIP codebook Text-to-Image
a teddy bear

'digital art of a colorful parrot' VQGAN+CLIP codebook Text-to-Image
digital art of a colorful parrot

'digital art of an amusement park' VQGAN+CLIP codebook Text-to-Image
digital art of an amusement park


Name: Aleph2Image Gamma
Author: Ryan Murdock
Original script: https://colab.research.google.com/drive/1VAO22MNQekkrVq8ey2pCRznz4A0_jY29
Time for 512×512 on a 3090: 2 minutes 1 second
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: This one seems to evolve white blotches that grow and take over the entire image. Before the white out stage the images tend to have too much contrast.

'H R Giger' Aleph2Image Gamma Text-to-Image
H R Giger

'surrealism' Aleph2Image Gamma Text-to-Image
surrealism

'seascape painting' Aleph2Image Gamma Text-to-Image
seascape painting


Name: Aleph2Image Delta
Author: Ryan Murdock
Original script: https://colab.research.google.com/drive/1oA1fZP7N1uPBxwbGIvOEXbTsq2ORa9vb
Time for 512×512 on a 3090: 2 minutes 1 second
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: A newer revision of Aleph2Image that doesn’t have the white out issues. The resulting images have much more vibrant colors and that may be a good or bad point depending on your preferences.

'a sketch of an angry person' Aleph2Image Delta Text-to-Image
a sketch of an angry person

'a spooky forest' Aleph2Image Delta Text-to-Image
a spooky forest

'a sunset in the style of Rembrandt' Aleph2Image Delta Text-to-Image
a sunset in the style of Rembrandt

'a surrealist painting of a forest path' Aleph2Image Delta Text-to-Image
a surrealist painting of a forest path

'a tropical beach' Aleph2Image Delta Text-to-Image
a tropical beach


Name: Aleph2Image Delta v2
Author: Ryan Murdock
Original script: https://colab.research.google.com/drive/1NGM9L8qP0gwl5z5GAuB_bd0wTNsxqclG
Time for 512×512 on a 3090: 3 minutes 42 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: 512×512 7 minutes 05 seconds
Description: A newer revision of Aleph2Image Delta that gives much sharper results. The resulting images tend to be similar to each other for each prompt text so not a lot of variety.

'a cartoon of love in the style of Claude Monet' Aleph2Image Delta v2 Text-to-Image
a cartoon of love in the style of Claude Monet

'a detailed painting of a rose' Aleph2Image Delta v2 Text-to-Image
a detailed painting of a rose

'a drawing of a volcano' Aleph2Image v2 Delta Text-to-Image
a drawing of a volcano

'a house' Aleph2Image v2 Delta Text-to-Image
a house

'a submarine' Aleph2Image v2 Delta Text-to-Image
a submarine


Name: Deep Daze Fourier
Author: Vadim Epstein
Original script: https://colab.research.google.com/gist/afiaka87/e018dfa86d8a716662d30c543ce1b78e/text2image-siren.ipynb
Time for 512×512 on a 3090: 4 minutes 54 seconds
Maximum resolution on a 24 GB 3090: 512×512 or 640×360
Maximum resolution on an 8GB 2080: 128×128 2 minutes 59 seconds
Description: Creates more collaged images with sharp, crisp bright colors.

'a pencil sketch of a vampire made of bones' Deep Daze Fourier Text-to-Image
a pencil sketch of a vampire made of bones

'H R Giger' Deep Daze Fourier Text-to-Image
H R Giger

'medusa made of wood' Deep Daze Fourier Text-to-Image
medusa made of wood

'Shrek eating pizza' Deep Daze Fourier Text-to-Image
Shrek eating pizza

'surrealist Homer Simpson' Deep Daze Fourier Text-to-Image
surrealist Homer Simpson


Name: Text2Image v2
Author: Denis Malimonov
Original script: https://colab.research.google.com/github/tg-bomze/collection-of-notebooks/blob/master/Text2Image_v2.ipynb
Time for 512×512 on a 3090: 1 minute 48 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: 512×512 3 minutes 12 seconds
Description: Can give more abstract results of the input phrase. Colors and details can be sharp, but not always. Good variety of output for each input phrase. Definitely worth a try.

'a fireplace made of voxels' Text2Image v2 Text-to-Image
a fireplace made of voxels

'a green tree frog in the style of M C Escher' Text2Image v2 Text-to-Image
a green tree frog in the style of M C Escher

'a pencil sketch of an evil alien' Text2Image v2 Text-to-Image
a pencil sketch of an evil alien

'a sea monster' Text2Image v2 Text-to-Image
a sea monster

'The Incredible Hulk made of silver' Text2Image v2 Text-to-Image
The Incredible Hulk made of silver


Name: The Big Sleep Customized
Author: NMKD
Original script: https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO
Time for 512×512 on a 3090: 1 minute 45 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: 512×512 3 minutes 09 seconds
Description: Another good one. Worth exploring further.

'a forest path' The Big Sleep Customized Text-to-Image
a forest path

'a watercolor painting of a colorful parrot in the style of Kandinsky' The Big Sleep Customized Text-to-Image
a watercolor painting of a colorful parrot in the style of Kandinsky

'a western town' The Big Sleep Customized Text-to-Image
a western town

'Christmas' The Big Sleep Customized Text-to-Image
Christmas

'medusa made of vines' The Big Sleep Customized Text-to-Image
medusa made of vines


Name: Big Sleep Minmax
Author: @!goose
Original script: https://colab.research.google.com/drive/12CnlS6lRGtieWujXs3GQ_OlghmFyl8ch
Time for 512×512 on a 3090: 1 minute 45 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: 512×512 3 minutes 10 seconds
Description: Another interesting Big Sleep variation. Allows a second phrase to be specified that is minimized in the output. For example if your prompt for a landscape painting has too many clouds you could specify clouds as the minimize prompt so the system outputs less clouds in the resulting image.

'a charcoal drawing of an eyeball' Big Sleep Minmax Text-to-Image
a charcoal drawing of an eyeball

'an ultrafine detailed painting of a crying person made of voxels' Big Sleep Minmax Text-to-Image
an ultrafine detailed painting of a crying person made of voxels

'dense woodland' Big Sleep Minmax Text-to-Image
dense woodland

'King Kong made of wrought iron in the style of Frida Kahlo' Big Sleep Minmax Text-to-Image
King Kong made of wrought iron in the style of Frida Kahlo

'Michael Myers' Big Sleep Minmax Text-to-Image
Michael Myers


Name: CLIP Pseudo Slime Mold
Author: hotgrits
Original script: https://discord.com/channels/729741769192767510/730484623028519072/850857930881892372
Time for 512×512 on a 3090: 2 minutes 57 seconds
Maximum resolution on a 24 GB 3090: Locked to 512×512
Maximum resolution on an 8GB 2080: Unable to run on 8GB VRAM
Description: This one gives unique output compared to the others. Really nicely defined sharp details. The colors come from any color palette you select (currently all the 3,479 palettes within Visions of Chaos can be used) so you can “tint” the resulting images with color shades you prefer.

'H R Giger' CLIP Pseudo Slime Mold Text-to-Image
H R Giger

'H R Giger' CLIP Pseudo Slime Mold Text-to-Image
H R Giger with a different color palette

'Shrek eating pizza' CLIP Pseudo Slime Mold Text-to-Image
Shrek eating pizza

'seascape painting' CLIP Pseudo Slime Mold Text-to-Image
seascape painting


Name: Aleph2Image Dall-E Remake
Author: Daniel Russell
Original script: https://colab.research.google.com/drive/17ZSyxCyHUnwI1BgZG22-UFOtCWFvqQjy
Time for 512×512 on a 3090: 3 minutes 42 seconds
Maximum resolution on a 24 GB 3090: 768×768
Maximum resolution on an 8GB 2080: 256×256 3 minutes 02 seconds
Description: Another Aleph2Image variant.

'a color pencil sketch of Jason Vorhees made of plastic' Aleph2Image Dall-E Remake Text-to-Image
a color pencil sketch of Jason Vorhees made of plastic

'a cubist painting of a science laboratory' Aleph2Image Dall-E Remake Text-to-Image
a cubist painting of a science laboratory

'a green tree frog in the style of Kandinsky' Aleph2Image Dall-E Remake Text-to-Image
a green tree frog in the style of Kandinsky

'a watercolor painting of Godzilla' Aleph2Image Dall-E Remake Text-to-Image
a watercolor painting of Godzilla

'an octopus' Aleph2Image Dall-E Remake Text-to-Image
an octopus


Name: VQGAN+CLIP v3
Author: Eleiber
Original script: https://colab.research.google.com/drive/1go6YwMFe5MX6XM9tv-cnQiSTU50N9EeT
Time for 512×512 on a 3090: 2 minutes 52 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 3 minutes 53 seconds
Description: “v3” because it is the third VQGAN system I have tried and it didn’t have a unique specific name. Gives clear sharp images. Can give very painterly results with visible brush strokes if you use “a painting of” before the prompt subject.

'a pencil sketch of a campfire in the style of Da Vinci' VQGAN+CLIP v3 Text-to-Image
a pencil sketch of a campfire in the style of Da Vinci

'a pop art painting of a lush rainforest' VQGAN+CLIP v3 Text-to-Image
a pop art painting of a lush rainforest

'a storybook illustration of a cityscape' VQGAN+CLIP v3 Text-to-Image
a storybook illustration of a cityscape

'an airbrush painting of frogs' VQGAN+CLIP v3 Text-to-Image
an airbrush painting of frogs

'the Amazon Rainforest' VQGAN+CLIP v3 Text-to-Image
the Amazon Rainforest

VQGAN+CLIP v3 allows specifying an image as the input starting point. If you take the output and repeatedly use it as the input with some minor image stretching each frame you can get a movie zooming into the Text-to-Image output. For this movie I used SRCNN Super Resolution to double the resolution of the frames and then Super Slo-Mo for optical flow frame interpolation (both SRCNN and Super Slo-Mo are included with Visions of Chaos). The VQGAN model was “vqgan_imagenet_f16_16384” and the CLIP model was “ViT-B/32”.

This next example movie is showing a “Self-Driven” zoom movie. As in a regular zoom movie the output frames are slightly stretched and fed back into the system each frame. The self-driven difference with this movie is that the Text-to-Image prompt text is automatically changed every 2 seconds by CLIP detecting what it “sees” in the current frame. This way the movie subjects are automatically changed and steered in new directions in a totally automated way. There is no human control except me setting the initial “A landscape” prompt. After that it was fully automated.

By default the CLIP Image Captioning script is very good at detecting what is in an image. Using the default accuracy resulted in a zoom movie that got stuck with a single topic or subject. One got stuck on a slight variation of a prompt dealing with kites, so as the zoom movie went deeper it only showed kites. Luckily after tweaking and decreasing the accuracy of the CLIP captioning the predicitons allow the resulting subjects to drift to new topics during the movie.


Name: VQGAN+CLIP v4
Author: crimeacs
Original script: https://colab.research.google.com/drive/1ZAus_gn2RhTZWzOWUpPERNC0Q8OhZRTZ
Time for 512×512 on a 3090: 2 minutes 37 seconds
Maximum resolution on a 24 GB 3090: 768×768 or 1120×480
Maximum resolution on an 8GB 2080: 256×256 3 minutes 05 seconds
Description: Another improved VQGAN system utilizing pooling. “v4” because it is the forth VQGAN system I have tried and it didn’t have a unique specific name.

'a fine art painting of a cozy den' VQGAN+CLIP v4 Text-to-Image
a fine art painting of a cozy den

'a king in the style of Kandinsky' VQGAN+CLIP v4 Text-to-Image
a king in the style of Kandinsky

'a nurse in the style of Edward Hopper' VQGAN+CLIP v4 Text-to-Image
a nurse in the style of Edward Hopper

'a pastel of a demon' VQGAN+CLIP v4 Text-to-Image
a pastel of a demon

'a watercolor painting of a mountain path' VQGAN+CLIP v4 Text-to-Image
a watercolor painting of a mountain path

VQGAN+CLIP v4 allows specifying an image as the input starting point. If you take the output and repeatedly use it as the input with some minor image stretching each frame you can get a movie zooming into the Text-to-Image output. For this movie I used SRCNN Super Resolution to double the resolution of the frames and then Super Slo-Mo for optical flow frame interpolation (both SRCNN and Super Slo-Mo are included with Visions of Chaos). The VQGAN model was “vqgan_imagenet_f16_16384” and the CLIP model was “ViT-B/32”.

The text prompts for each part came from an idea in a YouTube comment to try more non-specific terms to see what happens, so here are the results of “an image of fear”, “an image of humanity”, “an image of knowledge”, “an image of love”, “an image of morality” and “an image of serenity”.

Here is another example. This time using the prompt of various directors, ie “Stanley Kubrick imagery”, “David Lynch imagery” etc. No super resolution this time. Super Slo-Mo was used for optical flow. I wasn’t sure if YouTube would accept the potentially unsettling horror visuals and I do not want to risk the hassle of a strike, so being on the safe side I am hosting this one on my LBRY channel only. Click the following image to open the movie in a new window. Note that LBRY can be a lot slower to buffer, so you may need to pause it for a while to let the movie load in.

Directors Text-to-Image

If you find that too slow to buffer/load I also have a copy on my BitChute channel here.



Any Others I Missed?

Do you know of any other colabs and/or github Text-to-Image systems I have missed? Let me know and I will see if I can convert them to work with Visions of Chaos for a future release. If you know of any public Discords with other colabs being shared let me know too.

Jason.

Deep Daze Fourier Text-to-Image

NOTE: Make sure you also see this post that has a summary of all the Text-to-Image scripts supported by Visions of Chaos with example images.

More Fascinating Text-to-Image

This time “Deep Daze Fourier” from Vadim Epstein. Code available in this notebook.

Compared to the last Deep Daze that generated washed out and pastel shaded results this Deep Daze creates images with sharp, crisp bright colors.

Sample results

“Shrek eating pizza”

Deep Daze Fourier - Shrek Eating Pizza

Deep Daze Fourier - Shrek Eating Pizza

Deep Daze Fourier - Shrek Eating Pizza

Deep Daze Fourier - Shrek Eating Pizza

“H R Giger”

Deep Daze Fourier - H R Giger

Deep Daze Fourier - H R Giger

Deep Daze Fourier - H R Giger

Deep Daze Fourier - H R Giger

“Freddy Krueger”

Deep Daze Fourier - Freddy Krueger

Deep Daze Fourier - Freddy Krueger

Deep Daze Fourier - Freddy Krueger

Deep Daze Fourier - Freddy Krueger

“Surrealist Homer Simpson”

Deep Daze Fourier - Surrealist Homer Simpson

Deep Daze Fourier - Surrealist Homer Simpson

Deep Daze Fourier - Surrealist Homer Simpson

Deep Daze Fourier - Surrealist Homer Simpson

“rose bush”

Deep Daze Fourier - Rose Bush

Deep Daze Fourier - Rose Bush

Deep Daze Fourier - Rose Bush

Deep Daze Fourier - Rose Bush

Availability

This and the previous Text-to-Image systems I have experimented with (here, here and here) are now supported by a GUI front end in Visions of Chaos. As long as you install these prerequisites and have a decent GPU you will be able to run these systems yourself.

Text-to-Image GUI

For those who love to tinker I have now added a bunch more of the script parameters so you no longer have to edit the Python source code outside Visions of Chaos.

Other Text-to-Image

If you know of any other Text-to-Image systems (with sharable open-source code) then please let me know. All of the Text-to-Image systems I have tested so far all have their own unique behaviors and outputs so I will always be on the lookout for more new variations.

Jason.

Aleph2Image Text-to-Image

NOTE: Make sure you also see this post that has a summary of all the Text-to-Image scripts supported by Visions of Chaos with example images.

Previously I experimented with Big Sleep and other Text-to-Image systems.

This post covers variations of Aleph2Image Text-to_Image. Originally coded by Ryan Murdock.


Aleph2Image “Gamma”

Code from this colab. This one seems to evolve white blotches that grow and take over the entire image. Before the white out stage the images tend to have too much contrast. Previous results from Deep Daze were too washed out, this one is too “contrasty”. If they could both be pushed towards that “sweet spot” they would both look much better.

“surrealism”

Aleph2Image Gamma - Surrealism

Aleph2Image Gamma - Surrealism

Aleph2Image Gamma - Surrealism

Aleph2Image Gamma - Surrealism

“H R Giger”

Aleph2Image Gamma - H R Giger

Aleph2Image Gamma - H R Giger

Aleph2Image Gamma - H R Giger

Aleph2Image Gamma - H R Giger

“seascape oil painting”

Aleph2Image Gamma - Seascape Oil Painting

Aleph2Image Gamma - Seascape Oil Painting

Aleph2Image Gamma - Seascape Oil Painting

Aleph2Image Gamma - Seascape Oil Painting

“frogs in the rain”

Aleph2Image Gamma - Frogs In The Rain

Aleph2Image Gamma - Frogs In The Rain

Aleph2Image Gamma - Frogs In The Rain

Aleph2Image Gamma - Frogs In The Rain


Aleph2Image “Delta”

Code from this colab. A newer revision of Aleph2Image that doesn’t have the white out issues. The resulting images have much more vibrant colors.

“surrealism”

Aleph2Image Delta - Surrealism

Aleph2Image Delta - Surrealism

Aleph2Image Delta - Surrealism

Aleph2Image Delta - Surrealism

“H R Giger”

Aleph2Image Delta - H R Giger

Aleph2Image Delta - H R Giger

Aleph2Image Delta - H R Giger

Aleph2Image Delta - H R Giger

“seascape oil painting”

Aleph2Image Delta - Seascape Oil Painting

Aleph2Image Delta - Seascape Oil Painting

Aleph2Image Delta - Seascape Oil Painting

Aleph2Image Delta - Seascape Oil Painting

“frogs in the rain”

Aleph2Image Delta - Frogs In The Rain

Aleph2Image Delta - Frogs In The Rain

Aleph2Image Delta - Frogs In The Rain

Aleph2Image Delta - Frogs In The Rain


Improved Aleph2Image “Delta” v2

Code from this colab. A newer revision of Aleph2Image Delta that gives much better results, although the results tend to be similar to each other for each prompt text. This and Big Sleep would be the best 2 Text-to-Image systems I have experimented with so far.

“surrealism”

Aleph2Image Delta v2 - Surrealism

Aleph2Image Delta v2 - Surrealism

Aleph2Image Delta v2 - Surrealism

Aleph2Image Delta v2 - Surrealism

“H R Giger”

Aleph2Image Delta v2 - H R Giger

Aleph2Image Delta v2 - H R Giger

Aleph2Image Delta v2 - H R Giger

Aleph2Image Delta v2 - H R Giger

“seascape oil painting”

Aleph2Image Delta v2 - Seascape Oil Painting

Aleph2Image Delta v2 - Seascape Oil Painting

Aleph2Image Delta v2 - Seascape Oil Painting

Aleph2Image Delta v2 - Seascape Oil Painting

“frogs in the rain”

Aleph2Image Delta v2 - Frogs In The Rain

Aleph2Image Delta v2 - Frogs In The Rain

Aleph2Image Delta v2 - Frogs In The Rain

Aleph2Image Delta v2 - Frogs In The Rain


Easy GUI Front End

I include a simple GUI dialog front end for these Text-to-Image systems in Visions of Chaos. As long as you have the prerequisites installed you will be able to convert text prompts into single or multiple images.

Text-to-Image GUI

You do need a GPU with lots of VRAM for these to work (especially the 512×512 image models).

Jason.

Further Explorations Into Text-to-Image Machine Learning

NOTE: Make sure you also see this post that has a summary of all the Text-to-Image scripts supported by Visions of Chaos with example images.

After my initial experiments with Big Sleep Text-to-Image generation I looked around for some more examples to play with. I was really impressed with Big Sleep and you can see some examples of Big Sleep output in that original post. I still think Big Sleep is the best Text-to-Image code I have used so far and better than what is in this post.


Deep Daze

Deep Daze is by Phil Wang and the source code is available here.

Deep Daze tends to generate collage-like images. As the first example image shows the resulting images have a washed out or faded look. I put the rest of the example Deep Daze images through a quick Auto White Balance pass in GIMP.

“H R Giger”

DeepDaze - H R Giger

DeepDaze - H R Giger

“Rainforest”

DeepDaze - Rainforest

“night club”

DeepDaze - Night Club

“seascape painting”

DeepDaze - Seascape Painting

“flowing water”

DeepDaze - Flowing Water


VQGAN-CLIP z+quantize

VQGAN-CLIP using a z+quantize method is from Katherine Crowson. Source code is available here.

This method also has the option to use an image to seed the initial model rather than just random noise, but the following examples were all seeded with noise. The resulting images tend to be divided up into rectangular regions, but the resulting imagery is interesting.

“H R Giger”

VQGAN-CLIP z+quantize - H R Giger

VQGAN-CLIP z+quantize - H R Giger

VQGAN-CLIP z+quantize - H R Giger

VQGAN-CLIP z+quantize - H R Giger

“rainforest”

VQGAN-CLIP z+quantize - Rainforest

VQGAN-CLIP z+quantize - Rainforest

VQGAN-CLIP z+quantize - Rainforest

VQGAN-CLIP z+quantize - Rainforest

“night club”

VQGAN-CLIP z+quantize - Night Club

VQGAN-CLIP z+quantize - Night Club

VQGAN-CLIP z+quantize - Night Club

VQGAN-CLIP z+quantize - Night Club

“seascape painting”

VQGAN-CLIP z+quantize - Seascape Painting

VQGAN-CLIP z+quantize - Seascape Painting

VQGAN-CLIP z+quantize - Seascape Painting

VQGAN-CLIP z+quantize - Seascape Painting

“flowing water”

VQGAN-CLIP z+quantize - Flowing Water

VQGAN-CLIP z+quantize - Flowing Water

VQGAN-CLIP z+quantize - Flowing Water

VQGAN-CLIP z+quantize - Flowing Water


VQGAN-CLIP codebook

VQGAN-CLIP using a codebook method is also from Katherine Crowson. Source code is available here.

VQGAN-CLIP codebook seem to give very similar images for different seeds, so I have only shown two examples for each phrase.

“H R Giger”

VQGAN-CLIP codebook - H R Giger

VQGAN-CLIP codebook - H R Giger

“rainforest”

VQGAN-CLIP codebook - Rainforest

VQGAN-CLIP codebook - Rainforest

“night club”

VQGAN-CLIP codebook - Night Club

VQGAN-CLIP codebook - Night Club

“seascape painting”

VQGAN-CLIP codebook - Seascape Painting

VQGAN-CLIP codebook - Seascape Painting

“flowing water”

VQGAN-CLIP codebook - Flowing Water

VQGAN-CLIP codebook - Flowing Water


Other Text-to-Image Models?

If you know of any other available Text-to-Image systems (that are freely available and shareable) let me know.


Availability

You can follow the above links and download the Python code yourself if you are so inclined.

I do include a basic GUI front-end for these Text-to-Image generators in Visions of Chaos. As long as you have the prerequisites installed (which you would need to install to run these outside Visions of Chaos) then you can experiment with these models yourself without needing to use the command line.

Text-to-Image GUI

Jason.