{"id":8120,"date":"2023-02-08T10:41:07","date_gmt":"2023-02-08T17:41:07","guid":{"rendered":"https:\/\/mattfife.com\/?p=8120"},"modified":"2023-02-08T11:06:06","modified_gmt":"2023-02-08T18:06:06","slug":"unreal-engine-5-metahuman-and-stable-diffusion","status":"publish","type":"post","link":"https:\/\/mattfife.com\/?p=8120","title":{"rendered":"Unreal Engine 5 Metahuman and Stable Diffusion"},"content":{"rendered":"\n

CoffeeVectors wanted to see what kind of workflow he could build<\/a> bridging Epic’s MetaHuman<\/a> with AI image synthesis platforms like Stable Diffusion. His experiments were really interesting and instructive to other beginners.<\/p>\n\n\n\n

He started with a simple face generated by stable diffusion:<\/p>\n\n\n

\n
\"\"<\/figure>\n<\/div>\n\n\n

He then fed that image into Metahuman as a new starting point and cycled through a few generations. With each cycle, you can change the prompt and steer things in slightly different directions. It becomes less about a single initial prompt and more about understanding\/modifying the larger system of settings interacting with each other. The results were actually quite good:<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

I thought he had a good observation on creating prompts here:<\/p>\n\n\n\n

\n

Don’t get tunnel vision on the prompts. There\u2019s more to a car than the engine. Prompts are important but they\u2019re not everything. With platforms like Dall-E 2 where underlying variables aren\u2019t exposed, the prompts do play a dominant role.<\/p>\n\n\n\n

But with Stable Diffusion and Midjourney, there are more controls available to you that affect the output. If you’re not getting what you want from prompts alone in Stable Diffusion, for instance, it could be because you need to shop around the sampler methods and CFG Scale values. Even the starting resolution affects the images you get because it changes the initial noise pattern<\/p>\n<\/blockquote>\n\n\n\n

Definitely worth the read if you’re interested.<\/p>\n\n\n\n

Links:<\/p>\n\n\n\n