New Generative Tool Provides Images to Accompany Step-by-step Instructions

LEGO can show you how it’s done.

Proper instructions can be the difference between success and failure, whether for a parent putting together a crib or someone administering CPR.

While large language models (LLMs) can provide step-by-step instructions for assembling a crib, administering CPR, and other activities, Bolin Lai thinks they can go further.

Lai is a machine learning Ph.D. student who developed LEGO. This new framework allows generative artificial intelligence (AI) models to create first-person synthetic images based on text prompts. These images provide users with visual step-by-step instructions to complete a task.