First thing that came to mind when I saw this was:
“Damn, this could be a cool RL environment”
Give a model a 3D design and ask it to build it using LEGO bricks, then come up with a heuristic reward based on visual similarity, size, structural integrity, number of bricks used, and other factors.
Opus 5.5 designing LEGO 👀
I asked it to design a Microduck I can build with real LEGO pieces. It:
> designed it life-size using 1113 real LEGO parts
> verified: 3,204 connections, 0 collisions, every step buildable, centre of mass inside the feet 🤯
> made a 141-page LEGO-style booklet (237 steps)
> priced every piece in the browser and prepared the orders on BrickLink