{"id":15767,"date":"2022-09-19T16:42:56","date_gmt":"2022-09-19T07:42:56","guid":{"rendered":"https:\/\/automaton-media.com\/en\/?p=15767"},"modified":"2022-12-01T16:16:37","modified_gmt":"2022-12-01T07:16:37","slug":"20220919-15767","status":"publish","type":"post","link":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/","title":{"rendered":"Scientist creates playable Pok\u00e9mon overworld using a neural network"},"content":{"rendered":"\n<p><br><br>Ollin Boer Bohan, a deep learning scientist at NVIDIA, has created a playable <em>Pok\u00e9mon<\/em> overworld that is generated by a neural network. The demo creates visuals that resemble a <em>Pok\u00e9mon<\/em> game and anyone can try it out for themselves via a web browser.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">For fun, I trained a neural network to mimic a playable Pok\u00e9mon overworld (web demo in the post) <a href=\"https:\/\/t.co\/yuodVssIAI\">https:\/\/t.co\/yuodVssIAI<\/a> <a href=\"https:\/\/t.co\/GdOpl6d3kY\">pic.twitter.com\/GdOpl6d3kY<\/a><\/p>&mdash; Ollin Boer Bohan (@madebyollin) <a href=\"https:\/\/twitter.com\/madebyollin\/status\/1566838643771457536?ref_src=twsrc%5Etfw\">September 5, 2022<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1000\" height=\"550\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" src=\"http:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1.jpg\" alt=\"\" class=\"wp-image-15771\" srcset=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1.jpg 1000w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1-600x330.jpg 600w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1-380x209.jpg 380w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1-768x422.jpg 768w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1-150x83.jpg 150w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1-300x165.jpg 300w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1-696x383.jpg 696w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-002-1-764x420.jpg 764w\" \/><figcaption>The left image is from the Virtual Console release of Pok\u00e9mon Red while the right image is from Pok\u00e9mon Diamond and Pearl.<\/figcaption><\/figure>\n\n\n\n<p><br>Taking a look at Bohan\u2019s demo shows that it does indeed bear a close likeness to a <em>Pok\u00e9mon<\/em> game. Judging from the style of the playable character and the scenery, it appears to be largely based on <em>Pok\u00e9mon Diamond and Pearl<\/em>. <\/p>\n\n\n\n<p>The demo is playable, and you can use keyboard input to move the player character up, down, left, and right. As the character moves location, the scenery also changes in real time. That being said, the way in which the world is created causes the visuals to be a little unstable. This, in turn, produces an unsettling atmosphere.<\/p>\n\n\n\n<p>As the player character moves around the world, objects such as grass or ledges pop in and out of existence, and roads that you just walked across can disappear just as suddenly as new bits of scenery can come into view. Even if you just stand in place, there is still a subtle yet noticeable fluctuation or wobble in the visuals. It looks very much like a <em>Pok\u00e9mon<\/em> game, but one where just about everything lacks stability. However, there\u2019s also a strange charm to it\u2014almost like you are seeing a dream or an illusion.<\/p>\n\n\n\n<p>While the demo looks like a video game, it doesn\u2019t reproduce any gameplay elements. You can only move around and view the scenery, occasionally being able to enter buildings. &nbsp;<br><\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1200\" height=\"586\" sizes=\"auto, (max-width: 1200px) 100vw, 1200px\" src=\"http:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001.jpg\" alt=\"\" class=\"wp-image-15772\" srcset=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001.jpg 1200w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-600x293.jpg 600w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-380x186.jpg 380w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-768x375.jpg 768w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-150x73.jpg 150w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-300x147.jpg 300w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-696x340.jpg 696w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-1068x522.jpg 1068w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-860x420.jpg 860w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-001-533x261.jpg 533w\" \/><figcaption>Image from Ollin Boer Bohan\u2019s demo. <\/figcaption><\/figure>\n\n\n\n<p><br>The neural network that Bohan trained to create this demo is a computing system that is modeled on the human brain and nervous system. It is a machine learning process that creates an imitation by using actual video frames of <em>Pok\u00e9mon<\/em> gameplay that have been fed to it by Bohan.<\/p>\n\n\n\n<p>The network does not reproduce the inner workings of an actual game program; it only predicts the kind of visuals that would result from the corresponding player input and generates an appropriate image. This is the reason why the visuals continue to change as the character moves around.<br><\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1200\" height=\"586\" sizes=\"auto, (max-width: 1200px) 100vw, 1200px\" src=\"http:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003.jpg\" alt=\"\" class=\"wp-image-15770\" srcset=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003.jpg 1200w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-600x293.jpg 600w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-380x186.jpg 380w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-768x375.jpg 768w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-150x73.jpg 150w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-300x147.jpg 300w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-696x340.jpg 696w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-1068x522.jpg 1068w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-860x420.jpg 860w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-003-533x261.jpg 533w\" \/><figcaption>Image from Ollin Boer Bohan\u2019s demo. <\/figcaption><\/figure>\n\n\n\n<p><br>For those who are interested in learning more about how this neural network came to be, there\u2019s a <a href=\"https:\/\/madebyoll.in\/posts\/game_emulation_via_dnn\/\" target=\"_blank\" rel=\"noreferrer noopener\">thorough technological explanation<\/a> of it on Bohan\u2019s website.<\/p>\n\n\n\n<p>Bohan also discusses the future of neural networks and whether the technology may one day be able to reproduce an entire game. They note that as the imitations created by these kinds of neural networks continue to become more accurate, it will be theoretically possible to replicate any kind of system that you want.<\/p>\n\n\n\n<p>Even today, neural networks and deep learning are already being used by developers in image enhancement and upscaling technologies like DLSS. We will likely see even more ways that these technologies can be harnessed in the future.<br><br><br><br><\/p>\n\n\n\n<p style=\"font-size:12px\"><em>Written by. Marco Farinaccia based on the<a href=\"https:\/\/automaton-media.com\/articles\/newsjp\/20220917-219727\/\" target=\"_blank\" rel=\"noreferrer noopener\"> original Japanese article<\/a> (original article&#8217;s publication date: 2022-09-17 20:03 JST)<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Ollin Boer Bohan, a deep learning scientist at NVIDIA, has created a playable Pok\u00e9mon overworld that is generated by a neural network. The demo creates visuals that resemble a Pok\u00e9mon game and anyone can try it out for themselves via a web browser.<\/p>\n","protected":false},"author":30,"featured_media":15773,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_gspb_post_css":"","footnotes":""},"categories":[3],"tags":[70],"class_list":["post-15767","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-pokemon-series"],"blocksy_meta":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Scientist creates playable Pok\u00e9mon overworld using a neural network - AUTOMATON WEST<\/title>\n<meta name=\"description\" content=\"Ollin Boer Bohan, a deep learning scientist at NVIDIA, has created a playable Pok\u00e9mon overworld that is generated by a neural network. The demo creates visuals that resemble a Pok\u00e9mon game and anyone can try it out for themselves via a web browser.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Scientist creates playable Pok\u00e9mon overworld using a neural network - AUTOMATON WEST\" \/>\n<meta property=\"og:description\" content=\"Ollin Boer Bohan, a deep learning scientist at NVIDIA, has created a playable Pok\u00e9mon overworld that is generated by a neural network. The demo creates visuals that resemble a Pok\u00e9mon game and anyone can try it out for themselves via a web browser.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/\" \/>\n<meta property=\"og:site_name\" content=\"AUTOMATON WEST\" \/>\n<meta property=\"article:published_time\" content=\"2022-09-19T07:42:56+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-01T07:16:37+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-header.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1383\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Sayoko Narita\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AUTOMATON_ENG\" \/>\n<meta name=\"twitter:site\" content=\"@AUTOMATON_ENG\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sayoko Narita\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Scientist creates playable Pok\u00e9mon overworld using a neural network - AUTOMATON WEST","description":"Ollin Boer Bohan, a deep learning scientist at NVIDIA, has created a playable Pok\u00e9mon overworld that is generated by a neural network. The demo creates visuals that resemble a Pok\u00e9mon game and anyone can try it out for themselves via a web browser.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/","og_locale":"en_US","og_type":"article","og_title":"Scientist creates playable Pok\u00e9mon overworld using a neural network - AUTOMATON WEST","og_description":"Ollin Boer Bohan, a deep learning scientist at NVIDIA, has created a playable Pok\u00e9mon overworld that is generated by a neural network. The demo creates visuals that resemble a Pok\u00e9mon game and anyone can try it out for themselves via a web browser.","og_url":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/","og_site_name":"AUTOMATON WEST","article_published_time":"2022-09-19T07:42:56+00:00","article_modified_time":"2022-12-01T07:16:37+00:00","og_image":[{"width":1383,"height":675,"url":"http:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-header.jpg","type":"image\/jpeg"}],"author":"Sayoko Narita","twitter_card":"summary_large_image","twitter_creator":"@AUTOMATON_ENG","twitter_site":"@AUTOMATON_ENG","twitter_misc":{"Written by":"Sayoko Narita","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/#article","isPartOf":{"@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/"},"author":{"name":"Sayoko Narita","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/person\/6ff2721c450e20970538373b7515eaf6"},"headline":"Scientist creates playable Pok\u00e9mon overworld using a neural network","datePublished":"2022-09-19T07:42:56+00:00","dateModified":"2022-12-01T07:16:37+00:00","mainEntityOfPage":{"@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/"},"wordCount":564,"publisher":{"@id":"https:\/\/automaton-media.com\/en\/#organization"},"image":{"@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/#primaryimage"},"thumbnailUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-header.jpg","keywords":["Pokemon Series"],"articleSection":["News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/","url":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/","name":"Scientist creates playable Pok\u00e9mon overworld using a neural network - AUTOMATON WEST","isPartOf":{"@id":"https:\/\/automaton-media.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/#primaryimage"},"image":{"@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/#primaryimage"},"thumbnailUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-header.jpg","datePublished":"2022-09-19T07:42:56+00:00","dateModified":"2022-12-01T07:16:37+00:00","description":"Ollin Boer Bohan, a deep learning scientist at NVIDIA, has created a playable Pok\u00e9mon overworld that is generated by a neural network. The demo creates visuals that resemble a Pok\u00e9mon game and anyone can try it out for themselves via a web browser.","breadcrumb":{"@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/automaton-media.com\/en\/news\/20220919-15767\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/#primaryimage","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-header.jpg","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2022\/09\/20220917-219727-header.jpg","width":1383,"height":675,"caption":"Image from Ollin Boer Bohan\u2019s demo."},{"@type":"BreadcrumbList","@id":"https:\/\/automaton-media.com\/en\/news\/20220919-15767\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u30db\u30fc\u30e0","item":"https:\/\/automaton-media.com\/en\/"},{"@type":"ListItem","position":2,"name":"Scientist creates playable Pok\u00e9mon overworld using a neural network"}]},{"@type":"WebSite","@id":"https:\/\/automaton-media.com\/en\/#website","url":"https:\/\/automaton-media.com\/en\/","name":"AUTOMATON WEST","description":"AUTOMATON is a website that covers the Japanese gaming world. We bring you the news on video games from Osaka and Tokyo.","publisher":{"@id":"https:\/\/automaton-media.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/automaton-media.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/automaton-media.com\/en\/#organization","name":"\u682a\u5f0f\u4f1a\u793e\u30a2\u30af\u30c6\u30a3\u30d6\u30b2\u30fc\u30df\u30f3\u30b0\u30e1\u30c7\u30a3\u30a2","url":"https:\/\/automaton-media.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2021\/04\/activegamingmedia_logo.png","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2021\/04\/activegamingmedia_logo.png","width":374,"height":190,"caption":"\u682a\u5f0f\u4f1a\u793e\u30a2\u30af\u30c6\u30a3\u30d6\u30b2\u30fc\u30df\u30f3\u30b0\u30e1\u30c7\u30a3\u30a2"},"image":{"@id":"https:\/\/automaton-media.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/AUTOMATON_ENG","https:\/\/www.youtube.com\/channel\/UCabvYnvuUUbbGUrxkaFRgSA"]},{"@type":"Person","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/person\/6ff2721c450e20970538373b7515eaf6","name":"Sayoko Narita","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2023\/12\/Narita2-150x150-1-100x100.jpg","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2023\/12\/Narita2-150x150-1-100x100.jpg","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2023\/12\/Narita2-150x150-1-100x100.jpg","caption":"Sayoko Narita"},"description":"JP AUTOMATON writer","url":"https:\/\/automaton-media.com\/en\/author\/seiji-narita\/"}]}},"_links":{"self":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/15767","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/users\/30"}],"replies":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/comments?post=15767"}],"version-history":[{"count":4,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/15767\/revisions"}],"predecessor-version":[{"id":15776,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/15767\/revisions\/15776"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/media\/15773"}],"wp:attachment":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/media?parent=15767"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/categories?post=15767"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/tags?post=15767"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}