clip+vqgan - AI Weirdness

A wooden structure on stilts, with a slatted railing and huge crossbeams

Remember those wooden playgrounds? AI doesn't.

By Janelle Shane On January 07, 2022 - 4 min read

I remember when my hometown got one of these giant wooden playgrounds. It must have been in the early 90s and a kid could get lost for hours in there. Or injured or full of splinters or chromated copper arsenate I guess, which is why you don't see

How to haunt and unhaunt a house

By Janelle Shane On October 08, 2021 - 3 min read

What do you get if you instruct an AI to turn a house into the most haunted house in the world? What if you ask it for the LEAST haunted house? How does an AI know what "haunted" looks like, anyways? I did some experiments with CLIP+VQGAN

Several lumps of olden cake covered with generous dollops of creamy frosting.

Neural networks vs the Bake-off technical challenge

By Janelle Shane On October 01, 2021 - 4 min read

There's this baking competition I really like, and one of the elements in every show is what they call the Technical Challenge. In the Technical Challenge, Great British Bakeoff contestants have to bake something they may never have seen before, based solely on a brief description and a

The cake is covered in a sagging marshmallowy coating that might once have had sleek robotic curves.

AI cake fails

By Janelle Shane On August 18, 2021 - 5 min read

AI cake fails are unlike any cake fails I've seen before. What do you get when your cake is being generated by something that's seen lots of pictures labeled "cake" but has never had a cake or experienced physics? CLIP+VQGAN are two algorithms

A painting of stone columns, redwood treetops, and humanoid stone pillars

My favorite nonexistent painter

By Janelle Shane On August 06, 2021 - 3 min read

People have noted [https://twitter.com/moultano/status/1418256870259580934?s=20] that when using giant internet-trained AIs like CLIP+VQGAN to generate images, you get much nicer-looking images if you include an artist byline. Here's "Internet Infrastructure" And here's "Internet Infrastructure by J*

An AI-generated room with a confusing, sprawling piece of furniture in it.

Can I generate a gothic wardrobe?

By Janelle Shane On July 23, 2021 - 3 min read

Like other ambiguous [https://www.aiweirdness.com/the-art-of-asking-nicely/] image-generation [https://www.aiweirdness.com/why-is-generated-furniture-so-cursed/] prompts [https://www.aiweirdness.com/internet-grab-bag/], asking for "a gothic wardrobe" had the AI hedging its bets. In CLIP+VQGAN's internet training, those words might go with pictures of clothes in styles

Two chairs with seats of thick knotted pieces of wood and backs like carved pillars.

Generated furniture: cursed, but beautiful

By Janelle Shane On July 16, 2021 - 4 min read

Beetle kill pine is a popular wood in Colorado, salvaged from trees killed by pine bark beetles. While the dead trees stand before harvesting, a fungus colonizes them, giving the wood interesting blue-grey streaks called spalting. It's a really pretty wood. But AI apparently thinks "a chair

Generating images from an internet grab bag

By Janelle Shane On July 09, 2021 - 2 min read

Still amazed by this: Here's CLIP+VQGAN [https://aiweirdness.com/post/655607559221379072/the-art-of-asking-nicely] (trained on internet photos and their accompanying text), prompted two different ways: "A car driving down a desert road in monument valley" A car driving down a desert road in monument valley"

The art of asking nicely

By Janelle Shane On July 02, 2021 - 5 min read

There are upsides to working with a neural net that trained on a huge collection of internet images and text. One is that, instead of ominous grey geometric blobs [https://aiweirdness.com/post/177091486527/this-ai-is-bad-at-drawing-but-will-try-anyways] when it doesn't understand your prompt (there is a free interactive demo of

Tag: clip+vqgan

Remember those wooden playgrounds? AI doesn't.

How to haunt and unhaunt a house

Neural networks vs the Bake-off technical challenge

AI cake fails

My favorite nonexistent painter

Can I generate a gothic wardrobe?

Generated furniture: cursed, but beautiful

Generating images from an internet grab bag

The art of asking nicely

Writing

Subscribe

Recent Posts

Minecraft with object impermanence

Bonus: In Which The Adventurer Attempts to Build a Website

Botober 2024

Bonus: "Ignore all previous instructions" gets weirder

An exercise in frustration

Bonus: A unicorn goes downhill

Follow

Minecraft with object impermanence

Bonus: In Which The Adventurer Attempts to Build a Website

Botober 2024