{"id":35894,"date":"2024-08-23T16:04:57","date_gmt":"2024-08-23T07:04:57","guid":{"rendered":"https:\/\/automaton-media.com\/en\/?p=35894"},"modified":"2024-08-23T16:04:59","modified_gmt":"2024-08-23T07:04:59","slug":"ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing","status":"publish","type":"post","link":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/","title":{"rendered":"PS5 is teaching AI how to play games like a human to automate testing\u00a0"},"content":{"rendered":"\n<p>Sony Interactive Entertainment\u2019s PS5 engineers held a lecture at Japan\u2019s Computer Entertainment Development Conference (CEDEC) on August 21. As reported by <a href=\"https:\/\/www.4gamer.net\/games\/512\/G051245\/20240822058\/\" target=\"_blank\" rel=\"noreferrer noopener\">4Gamer<\/a>, the presentation centered around the PS5 team\u2019s efforts to create an automated system for QA (quality assurance) testing, which interestingly involves using machine learning to simulate human-like gameplay.&nbsp;<\/p>\n\n\n\n<p>From the looks of it, the automated quality testing in question is not being applied to game development and looking for bugs in games themselves, but rather within the PlayStation 5\u2019s systems \u2013 such as its Home and Control Center systems. PS5\u2019s system software contains functions that are linked to gameplay and game progression (Activity Cards are one clear example), and such functions need to be tested by actually playing games.&nbsp;<\/p>\n\n\n\n<p>However, manual QA testing can only be performed a set number of times over the course of a project, which means that depending on the timing a bug occurs, it can end up being caught right before release, potentially disrupting plans, according to Sony\u2019s engineer. On the other hand, if automated, testing can be performed daily, which means bugs get detected early, and developers can react before they get saved to the project\u2019s source code.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1432\" height=\"801\" sizes=\"auto, (max-width: 1432px) 100vw, 1432px\" src=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894.-001JPG.jpg\" alt=\"\" class=\"wp-image-35898\" srcset=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894.-001JPG.jpg 1432w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894.-001JPG-380x213.jpg 380w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894.-001JPG-768x430.jpg 768w\" \/><figcaption class=\"wp-element-caption\">Image via <a href=\"https:\/\/www.4gamer.net\/games\/512\/G051245\/20240822058\/\" target=\"_blank\" rel=\"noreferrer noopener\">4Gamer<\/a><\/figcaption><\/figure>\n\n\n\n<p>Sony\u2019s solution to this challenge was to develop an automatic play system that incorporates AI. This system is run on a PC by the engineer, and it fetches screen data from the PS5. In response to the game data it receives, it determines and sends back controller inputs to the PS5 i.e., plays the game.&nbsp;&nbsp;<\/p>\n\n\n\n<p>The system consists of two \u201cagents\u201d \u2013 a replay agent and an imitation agent. The replay agent merely plays back previously recorded manual gameplay and is used for menu navigation and game scenes that always progress in a predetermined way without random variables. On the other hand, the imitation agent is an AI model that has learned how to play games like a human using a type of machine learning called imitation learning.&nbsp;<\/p>\n\n\n\n<p>The imitation agent reproduces behavioral patterns from the sample data it was trained on \u2013 human gameplay. This means that it can play games in real time even when there are random factors present. Sony\u2019s automatic play system switches between these two agents throughout the testing process. To determine when a switch from the replay agent to the imitation agent is needed, the system uses scene recognition and template matching features to check whether a game scene matches pre-prepared data or not.&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sony&#8217;s PS5 quality assurance team is using imitation machine learning to make an AI model that can play games like a human.<\/p>\n","protected":false},"author":55,"featured_media":35903,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_gspb_post_css":"","footnotes":""},"categories":[3],"tags":[17],"class_list":["post-35894","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-japan-related-news"],"blocksy_meta":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>PS5 is teaching AI how to play games like a human to automate testing\u00a0 - AUTOMATON WEST<\/title>\n<meta name=\"description\" content=\"Sony&#039;s PS5 quality assurance team is using imitation machine learning to make an AI model that can play games like a human.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"PS5 is teaching AI how to play games like a human to automate testing\u00a0 - AUTOMATON WEST\" \/>\n<meta property=\"og:description\" content=\"Sony&#039;s PS5 quality assurance team is using imitation machine learning to make an AI model that can play games like a human.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"AUTOMATON WEST\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-23T07:04:57+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-23T07:04:59+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894-header.JPG.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"801\" \/>\n\t<meta property=\"og:image:height\" content=\"448\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Amber V\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AUTOMATON_ENG\" \/>\n<meta name=\"twitter:site\" content=\"@AUTOMATON_ENG\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Amber V\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"PS5 is teaching AI how to play games like a human to automate testing\u00a0 - AUTOMATON WEST","description":"Sony's PS5 quality assurance team is using imitation machine learning to make an AI model that can play games like a human.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/","og_locale":"en_US","og_type":"article","og_title":"PS5 is teaching AI how to play games like a human to automate testing\u00a0 - AUTOMATON WEST","og_description":"Sony's PS5 quality assurance team is using imitation machine learning to make an AI model that can play games like a human.","og_url":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/","og_site_name":"AUTOMATON WEST","article_published_time":"2024-08-23T07:04:57+00:00","article_modified_time":"2024-08-23T07:04:59+00:00","og_image":[{"width":801,"height":448,"url":"http:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894-header.JPG.jpg","type":"image\/jpeg"}],"author":"Amber V","twitter_card":"summary_large_image","twitter_creator":"@AUTOMATON_ENG","twitter_site":"@AUTOMATON_ENG","twitter_misc":{"Written by":"Amber V","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#article","isPartOf":{"@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/"},"author":{"name":"Amber V","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/person\/fdc6517a00e35b6917ffdb02e8b574d9"},"headline":"PS5 is teaching AI how to play games like a human to automate testing\u00a0","datePublished":"2024-08-23T07:04:57+00:00","dateModified":"2024-08-23T07:04:59+00:00","mainEntityOfPage":{"@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/"},"wordCount":435,"commentCount":0,"publisher":{"@id":"https:\/\/automaton-media.com\/en\/#organization"},"image":{"@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894-header.JPG.jpg","keywords":["News (Japan-related)"],"articleSection":["News"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/","url":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/","name":"PS5 is teaching AI how to play games like a human to automate testing\u00a0 - AUTOMATON WEST","isPartOf":{"@id":"https:\/\/automaton-media.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#primaryimage"},"image":{"@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894-header.JPG.jpg","datePublished":"2024-08-23T07:04:57+00:00","dateModified":"2024-08-23T07:04:59+00:00","description":"Sony's PS5 quality assurance team is using imitation machine learning to make an AI model that can play games like a human.","breadcrumb":{"@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#primaryimage","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894-header.JPG.jpg","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/08\/20240823-35894-header.JPG.jpg","width":801,"height":448,"caption":"PS5"},{"@type":"BreadcrumbList","@id":"https:\/\/automaton-media.com\/en\/news\/ps5-is-teaching-ai-how-to-play-games-like-a-human-to-automate-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u30db\u30fc\u30e0","item":"https:\/\/automaton-media.com\/en\/"},{"@type":"ListItem","position":2,"name":"PS5 is teaching AI how to play games like a human to automate testing\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/automaton-media.com\/en\/#website","url":"https:\/\/automaton-media.com\/en\/","name":"AUTOMATON WEST","description":"AUTOMATON is a website that covers the Japanese gaming world. We bring you the news on video games from Osaka and Tokyo.","publisher":{"@id":"https:\/\/automaton-media.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/automaton-media.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/automaton-media.com\/en\/#organization","name":"\u682a\u5f0f\u4f1a\u793e\u30a2\u30af\u30c6\u30a3\u30d6\u30b2\u30fc\u30df\u30f3\u30b0\u30e1\u30c7\u30a3\u30a2","url":"https:\/\/automaton-media.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2021\/04\/activegamingmedia_logo.png","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2021\/04\/activegamingmedia_logo.png","width":374,"height":190,"caption":"\u682a\u5f0f\u4f1a\u793e\u30a2\u30af\u30c6\u30a3\u30d6\u30b2\u30fc\u30df\u30f3\u30b0\u30e1\u30c7\u30a3\u30a2"},"image":{"@id":"https:\/\/automaton-media.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/AUTOMATON_ENG","https:\/\/www.youtube.com\/channel\/UCabvYnvuUUbbGUrxkaFRgSA"]},{"@type":"Person","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/person\/fdc6517a00e35b6917ffdb02e8b574d9","name":"Amber V","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/06\/12252024-100x100.jpg","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/06\/12252024-100x100.jpg","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/06\/12252024-100x100.jpg","caption":"Amber V"},"description":"Editor-in-Chief since October 2023. She grew up playing Duke Nukem and Wolfenstein with her dad, and is now enamored with obscure Japanese video games and internet culture. Currently devoted to growing Automaton West to the size of its Japanese sister-site, while making sure to keep news concise and developer stories deep and stimulating.","url":"https:\/\/automaton-media.com\/en\/author\/amber-vjestica\/"}]}},"_links":{"self":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/35894","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/users\/55"}],"replies":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/comments?post=35894"}],"version-history":[{"count":2,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/35894\/revisions"}],"predecessor-version":[{"id":35905,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/35894\/revisions\/35905"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/media\/35903"}],"wp:attachment":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/media?parent=35894"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/categories?post=35894"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/tags?post=35894"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}