mikker·1 day ago

Multi-modeling the Rocket Monster

This tweet got popular. It even brought out a hater or two demanding the receipts. So, without too much talk and definitely with no intention of selling you a course – here's the entire saga and agent transcripts that got me there.

I won't call it a workflow because it's all just made up as I go. There are tools and techniques that stay but mostly, you just talk to the models.

It all started when I was talking names for my Rails UI kit with my internet friend Marc.

CleanShot 2026-08-12 at 22.02.08@2x.png

This was november 2024.

Prompting in MidJourney was and is a very explorative process. It's about prompting something then prompting the prompt. Using the output as reference images for the next rounds of prompts. Until something badass randomly comes out.

The very first prompt was this and an RC car I found through Google Images:

minimal icon of a remote controlled buggy, vector style, yellow car, hot red background

CleanShot 2026-08-12 at 22.09.12@2x.png

I then tried the Niji 6 model instead and the slightly updated:

minimal icon of a remote controlled buggy with a giant jet engine on top, vector style, yellow car, hot red background

CleanShot 2026-08-12 at 22.09.38@2x.png

Something about that one output.

CleanShot 2026-08-12 at 22.03.15@2x.png

The red circle background was added manually by me. That's where the car originally came from.

Fast forward two years. And. Yeah, the forward has been very fast these two years.

I look at my UI kit again. AI and agentic coding has changed everything.

I could use an updated illustration for the updated 2.0 version.

CleanShot 2026-08-12 at 22.20.53@2x.png

That's the original car image + a character sheet of a stick figure guy I had made for a talk and used again for an illustration.

CleanShot 2026-08-12 at 22.24.37@2x.png
CleanShot 2026-08-12 at 22.24.58@2x.png

Alright, so I'm getting near something I quite like here. Not perfect but the composition is very cool.

I have an idea for another angle that would look awesome as the website footer maybe.

CleanShot 2026-08-12 at 22.26.04@2x.png
CleanShot 2026-08-12 at 22.26.26@2x.png

Huh. Clearly the model (gpt-image-2) is confused about the perspective here. I wonder how I could help it, I think.

ChatGPT can talk for very long without loosing its mind but image generation usually only gets worse and worse the longer the thread becomes (in my experience.)

In a new thread, I try the character sheet method that had worked for me before.

CleanShot 2026-08-12 at 22.28.17@2x.png

Take it back to the other one...

CleanShot 2026-08-12 at 22.29.42@2x.png

Better but still not it. The concept of a jet engine on the roof is clearly not something it has considered before.

I keep thinking: I know this is what I want. I'm convinced it'll look cool. How can I help the model get it right?

I remember having seen tweets about connecting coding agents to Blender via MCP. Surely, if I can model the car in actual 3d space, we can get a picture – or at least a draft composition – of it from any angle.

I open up codex. Ask it how do I connect you to Blender via mcp? Few different ways, it says. One is literally just uvx blender-mcp. Perfect for the amount of effort I'm willing to throw at this. Here's the actual thread transcript

Open Blender.app. Run uvx blender-mcp. Enable shit. They find each other.

Give Codex the character sheet and tell it to model it in Blender. Here's the actual thread.

Use blender mcp to model this car [Image #1] Make it looks as close to the reference image as possible. Feel free to imagine parts not visible on ref sheet

rocket_monster_front3q.png

"More detail"

rocket_monster_final_front.png

I wasn't too impressed with Codex' results. Or. I was impressed by any of this working at all! But the results didn't look like the car I knew and loved.

At least we could now generate a sketch of the exact angle we wanted.

CleanShot 2026-08-12 at 22.51.25@2x.png

Not bad now!

I wonder though... What if we gave the task to Fable?

Oh, a few weeks before this, I had already tried making ChatGPT create a fake photo shoot of the car. I gave it that as well.

CleanShot 2026-08-13 at 00.26.50@2x.png

Here's the very first, single prompt result:

image-132-27.jpeg

Insane. Here's the whole thread. It goes all the way to the gamified version.

Try expanding the tool calls there. You can follow the whole process as the agent contemplates its work from different angles. So interesting!

After a few rounds of back and forth, we arrive at the dusk scene from the original tweet.

image-339-61.jpeg

Already here, this is clearly just completely bonkers that a statistics based text generation machine can build this.

Through the medium of language (ish), it has to understand me. Understand the images I give it. Understand the concept of 3d space and the concept of apps and the concept of modeling the former in the latter.

Just. Completely. Bonkers.

Of course, we aren't even done.

Can you build it in Three.js I ask it. It can.

Make it animated, I say. Make the engine switch on and off.

It's pretty good!

I see a tweet of someone using Blender to model and choreograph a scene then Seedance 2.5 to make it realistic. I wonder ...

First output isn't very good. I passed it a recording of the Three.js scene as reference. Maybe I did it wrong?

CleanShot 2026-08-12 at 23.16.23@2x.png

Basically just a copy of the input.

How can I help it? I think. Maybe if I generate a still of a realistic render, tell it to use that, AND a video of the low-poly choreography, tell it to use that too.

So, off to ChatGPT again.

CleanShot 2026-08-12 at 23.19.28@2x.png

Exactly what we want!

Back to Seedance and Replicate.

CleanShot 2026-08-12 at 23.21.51@2x.png

And there we go. The final, tweeted, jawdropping version.

The Claude thread shows the rest of the path to the playable version which was basically asking it to make it drivable and that's it.

I hope this post showed you that …

  1. the future is here and it is bonkers
  2. there's no magic. It's just a matter of thinking what's my next step and playing yes, and with whatever output you get.

Have fun!

Newsletter

Mikker writes about software

EverythingPostsNotes