{"id":11320,"date":"2024-06-19T19:51:36","date_gmt":"2024-06-20T02:51:36","guid":{"rendered":"https:\/\/mattfife.com\/?p=11320"},"modified":"2024-08-31T14:21:50","modified_gmt":"2024-08-31T21:21:50","slug":"create-a-playable-game-from-a-single-image","status":"publish","type":"post","link":"https:\/\/mattfife.com\/?p=11320","title":{"rendered":"Create a playable game from a single image"},"content":{"rendered":"\n<p><a href=\"https:\/\/www.tomsguide.com\/features\/google-gemini-everything-we-know-about-the-advanced-ai-model\">Google researchers<\/a>&nbsp;have published a new artificial intelligence model that can take a text prompt, sketch or idea and turn it into a virtual world you can interact with and play.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"529\" height=\"298\" data-attachment-id=\"12204\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=12204\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/06\/wwbPn9vRkDzDUkvtrUM6oc.gif?fit=529%2C298&amp;ssl=1\" data-orig-size=\"529,298\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"wwbPn9vRkDzDUkvtrUM6oc\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/06\/wwbPn9vRkDzDUkvtrUM6oc.gif?fit=529%2C298&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/06\/wwbPn9vRkDzDUkvtrUM6oc.gif?resize=529%2C298&#038;ssl=1\" alt=\"\" class=\"wp-image-12204\"\/><\/figure>\n<\/div>\n\n\n<p>Named&nbsp;<a href=\"https:\/\/sites.google.com\/view\/genie-2024\/\" target=\"_blank\" rel=\"noreferrer noopener\">Genie<\/a>, the virtual world model was trained on gameplay and other videos found online and is currently a research preview. The games are 2D platformer style games.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Genie can be prompted with images it has never seen before, such as real world photographs or sketches, enabling people to interact with their imagined virtual worlds-\u2013essentially acting as a foundation world model. This is possible despite&nbsp;<strong>training without any action labels<\/strong>. Instead, Genie is trained from a large dataset of publicly available Internet videos. We focus on&nbsp;videos of 2D platformer games and robotics&nbsp;but our method is general and should work for any type of domain, and is scalable to ever larger Internet datasets.&nbsp;<\/p>\n<\/blockquote>\n\n\n\n<p>Links:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/sites.google.com\/view\/genie-2024\/home\">https:\/\/sites.google.com\/view\/genie-2024\/home<\/a><\/li>\n\n\n\n<li>Paper <a href=\"https:\/\/arxiv.org\/abs\/2402.15391\">https:\/\/arxiv.org\/abs\/2402.15391<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.tomsguide.com\/features\/google-gemini-everything-we-know-about-the-advanced-ai-model\">https:\/\/www.tomsguide.com\/features\/google-gemini-everything-we-know-about-the-advanced-ai-model<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Google researchers&nbsp;have published a new artificial intelligence model that can take a text prompt, sketch or idea and turn it into a virtual world you can interact with and play. Named&nbsp;Genie, the virtual world model was trained on gameplay and other videos found online and is currently a research preview. The games are 2D platformer style games. Genie can be prompted with images it has never seen before, such as real world photographs or sketches, enabling people to interact with&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/mattfife.com\/?p=11320\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[28,9],"tags":[],"class_list":["post-11320","post","type-post","status-publish","format-standard","hentry","category-ai","category-cool"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p4WECr-2WA","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/11320","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=11320"}],"version-history":[{"count":4,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/11320\/revisions"}],"predecessor-version":[{"id":12205,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/11320\/revisions\/12205"}],"wp:attachment":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=11320"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=11320"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=11320"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}