Please enjoy this advent calendar, generated and illustrated with the help of three machine learning models (GPT-3, DALL-E, and Midjourney)

Full door descriptions

  1. Eggnog as far as the eye could see
  2. The fantastical lion of Mor-Bollox
  3. Saturated Red Turkeys.
  4. Blue reindeer (they're bouncing)
  5. Candy Cane Palm Trees
  6. A smiling present.
  7. Blitzen, bowling
  8. Undy, Undy, Underscore.
  9. Cheetah print stegosaurus
  10. Whistling Christmas Trees
  11. Giraffes holly.
  12. Underwater pine tree
  13. Dire reindeer, before the meltdown
  14. Lightning Chestnuts
  15. Bouncing top hat beetle
  16. Laser-eyed deer
  17. Snakes in Hats
  18. Gecko Poinsettias
  19. Melted Ornaments
  20. Christmas on mars
  21. Tinsel Parrots
  22. Christmas Caroling snails
  23. Astro gingerbears in space suits
  24. A disgruntled christmas tree brandishing a plasma cannon
1. A family of Santa Clauses, posing for a photograph. 2. A sleigh pulled by a weasel. 3. A particularly foul, possibly magical green liquid. 4. A hand reaching through a curtain to steal a Christmas tree. 5. Santa Claus, jumping from a chair into a box. 6. Santa Claus bouncing on a trampoline, and playing a banjo. 7. A plate of seven yellow and seven purple rocks. 8. Snow blowing up into the air. 9. A grizzly bear driving a sno-cone cart. 10. A pack of wolves playing poker. Some are wearing antlers. 11. A reindeer with a plate of green-and-yellow cupcakes. 12. Santa Claus with a centipede on a leash. 13. A snowman holding a sign reading

How it was done:

I used GPT-3 to generate the door descriptions of an advent calendar by having it complete the following story:

It is the year 20022 and the robots have carried on certain human traditions. Many of them come and go, but every year without fail there is an advent calendar, originated by a glitchy robot santa in collaboration with a motorized christmas tree. The robots have researched the calendar and determined that the Christmas scenes behind each door are highly atypical of the human tradition, but everyone enjoys them anyways.
The Christmas advent calendar for the year 20022:
Brief door descriptions:

I used the original DaVinci variant of GPT-3, which tends to be better at generating weird text than the newer variants (which try too hard to make it look like text they've seen before). As usual, I kept maybe 1 in 10 door descriptions it generated, with the others being usually either too strange to illustrate, or close copies of doors it had already generated.

For the illustrations, I used two different text-to-image models, DALL-E2 and Midjourney, asking them both for something like "The minty breath of the Starfish, 16-bit pixel art game cut scene" in an attempt to get them to generate an image that would look good while tiny.

Unlike Pixray, which I used to generate images for the 2021 advent calendar, DALL-E2 and Midjourney aren't actually working with just a few pixels. Instead, they're faking it. Look at the image below, which DALL-E2 generated for the door description "The minty breath of the Starfish". It seems at first glance to be pixel art, but the pixels vary in alignment, size, and aspect ratio. Some pixels even have curved sides. It knows approximately what pixel art looks like but not WHY pixel art looks that way. I find the concept of fake pixel art pretty funny.

A starfish floats above the ocean floor between two rock cliffs, dangling a smaller sea creature on a blue string. The style is pixel art but upon closer inspection the resolution is much higher than the size of the "pixels" which are misshapen and misaligned.
Prompt: "The minty breath of the Starfish, 16-bit pixel art high resolution game scene"

Midjourney takes even more license with the concept of pixel art. It has a limited color palette and some lines with pixelated edges. But are those smooth gradients in the sky and water? And how big are its "pixels" anyways? The midjourney model is optimized to make things look pretty above all, including above fidelity to my weird prompts.

A starfish floats above a grass-covered rock on the beach as a long wave rolls in. The style is painterly pixel art, something like in a late 1990s point and click game, but even though some objects have blocky edges the pixels themselves are aliased and some are even rounded blobs.
Prompt: "The minty breath of the Starfish, 16-bit pixel art game cut scene --v 4 --ar 3:2"

The "minty breath of the Starfish" door is one of the ones I rejected as not likely to work well when illustrated. Sure enough, both models just slapped a starfish in an ocean scene and called it a day.

I collected a few other rejected/hard to illustrate doors that I nevertheless found interesting, and they're available as a bonus post!

Subscribe now