{"id":75415,"date":"2026-11-18T19:04:57","date_gmt":"2026-11-18T10:04:57","guid":{"rendered":"https:\/\/automaton-media.com\/en\/?p=75415"},"modified":"2026-11-18T19:04:59","modified_gmt":"2026-11-18T10:04:59","slug":"mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs","status":"publish","type":"post","link":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/","title":{"rendered":"miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">On November 13, <strong>miHoYo<\/strong>\u2019s in-house Honkai AI R&amp;D Team, in collaboration with researchers from the National University of Singapore and Tsinghua University, published a <a href=\"https:\/\/arxiv.org\/abs\/2611.18397\" target=\"_blank\" rel=\"noopener\">research paper<\/a> and <a href=\"https:\/\/mihoyo-gamer.github.io\/\" target=\"_blank\" rel=\"noopener\">project webpage<\/a> about their latest AI game agent, named Gamer. The project introduces Gamer as an AI model capable of playing complex 3D and 2D video games from start to finish without touching a single line of backend code.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">According to the research team&#8217;s paper and project page, Gamer does not rely on in-game data or dedicated APIs. Instead, the AI makes inputs relying only on what is shown on-screen, emulating \u201chuman-like behavior\u201d in the process. More specifically, Gamer uses screen images captured at 5 Hz per second as input and outputs keyboard and mouse movement commands.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1085\" height=\"605\" sizes=\"auto, (max-width: 1085px) 100vw, 1085px\" src=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-0023-1.jpg\" alt=\"\" class=\"wp-image-75425\" srcset=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-0023-1.jpg 1085w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-0023-1-380x212.jpg 380w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-0023-1-768x428.jpg 768w\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">To demonstrate the AI\u2019s capabilities, the paper showcased gameplay footage of Gamer successfully navigating through main quests and solving puzzles in the company\u2019s own game, <strong>Honkai: Star Rail<\/strong>. The footage shows the AI moving characters toward objectives, following NPCs around to progress, and even clearing enemy encounters on its own. Gamer also demonstrated the ability to independently complete five mini-games, ranging from puzzles requiring logical thinking to challenges demanding precise timing and accuracy.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1154\" height=\"769\" sizes=\"auto, (max-width: 1154px) 100vw, 1154px\" src=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-002g-1.jpg\" alt=\"\" class=\"wp-image-75426\" srcset=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-002g-1.jpg 1154w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-002g-1-380x253.jpg 380w, https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-002g-1-767x511.jpg 767w\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">A <a href=\"https:\/\/github.com\/RainBowLuoCS\/Gamer?tab=readme-ov-file\" target=\"_blank\" rel=\"noopener\">GitHub<\/a> page for the model has also been published, noting that the inference engine (Streaming-vLLM) used to run Gamer is scheduled to be released soon. It is important to note, however, that since the paper states that results were collected using high-performance data center GPUs such as H200s, it is unlikely that the model will see any personal use.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In response to concerns that the technology might encourage cheating and automated scripts, the research team emphasized that Gamer is part of an academic research project exploring universal agents for interactive environments. Its potential applications include accessibility assistance, game testing, and research on human-computer interaction. The team explicitly stated that it &#8220;does not endorse using Gamer for cheating, unauthorized access, exploiting security vulnerabilities, or any behavior that harms users or undermines fairness.&#8221;&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Related<\/strong>: <a href=\"https:\/\/automaton-media.com\/en\/news\/ai-voice-service-ordered-to-pay-mihoyo-112k-after-reproducing-the-voices-of-63-genshin-impact-character-without-permission\/\" target=\"_blank\" rel=\"noopener\"><strong>AI voice service ordered to pay miHoYo $112K after reproducing the voices of 63 Genshin Impact characters without permission<\/strong><\/a>&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/automaton-media.com\/en\/news\/mihoyo-to-shut-down-its-ai-powered-virtual-girlfriend-simulator-bside-olivia-lin-less-than-two-months-after-launch\/\" target=\"_blank\" rel=\"noopener\"><strong>miHoYo to shut down its AI-powered \u201cvirtual girlfriend\u201d simulator BSide: Olivia Lin less than two months after launch<\/strong><\/a>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The project is being headed by the Honkai AI R&#038;D Team, in collaboration with researchers from the National University of Singapore and Tsinghua University.<\/p>\n","protected":false},"author":93,"featured_media":75424,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_gspb_post_css":"","autoblue_enabled":true,"autoblue_custom_message":"","autoblue_shares":[{"did":"did:plc:uzrrhkfyjrfdsynj2voztcf2","date":"2026-11-18T10:05:07+00:00","uri":"at:\/\/did:plc:uzrrhkfyjrfdsynj2voztcf2\/app.bsky.feed.post\/3n2lcmns4en2v","response":"{\"uri\":\"at:\/\/did:plc:uzrrhkfyjrfdsynj2voztcf2\/app.bsky.feed.post\/3n2lcmns4en2v\",\"cid\":\"bafyreica7kojmxvb2kum5dsxkgj7uwe7t3zhveu4nfuqsb6zc2buc27lri\",\"commit\":{\"cid\":\"bafyreidtpcaqelkngp6zc4emno4axecp76ujzqwtr45jrde5evoa3xkzna\",\"rev\":\"3n2lcmnsj2v2v\"},\"validationStatus\":\"valid\"}"}],"autoblue_post_url":"","autoblue_publish_document":false,"footnotes":""},"categories":[64,3],"tags":[18],"class_list":["post-75415","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-game-development","category-news","tag-global-news"],"blocksy_meta":{"styles_descriptor":{"styles":{"desktop":"","tablet":"","mobile":""},"google_fonts":[],"version":8}},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0 - AUTOMATON WEST<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0 - AUTOMATON WEST\" \/>\n<meta property=\"og:description\" content=\"The project is being headed by the Honkai AI R&amp;D Team, in collaboration with researchers from the National University of Singapore and Tsinghua University.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/\" \/>\n<meta property=\"og:site_name\" content=\"AUTOMATON WEST\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-18T10:04:57+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-11-18T10:04:59+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-header-2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1309\" \/>\n\t<meta property=\"og:image:height\" content=\"727\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Akira Sada\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AUTOMATON_ENG\" \/>\n<meta name=\"twitter:site\" content=\"@AUTOMATON_ENG\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Akira Sada\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0 - AUTOMATON WEST","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/","og_locale":"en_US","og_type":"article","og_title":"miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0 - AUTOMATON WEST","og_description":"The project is being headed by the Honkai AI R&D Team, in collaboration with researchers from the National University of Singapore and Tsinghua University.","og_url":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/","og_site_name":"AUTOMATON WEST","article_published_time":"2026-11-18T10:04:57+00:00","article_modified_time":"2026-11-18T10:04:59+00:00","og_image":[{"width":1309,"height":727,"url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-header-2.jpg","type":"image\/jpeg"}],"author":"Akira Sada","twitter_card":"summary_large_image","twitter_creator":"@AUTOMATON_ENG","twitter_site":"@AUTOMATON_ENG","twitter_misc":{"Written by":"Akira Sada","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#article","isPartOf":{"@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/"},"author":{"name":"Akira Sada","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/person\/2577a6aa569db379ace31f58d9313846"},"headline":"miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0","datePublished":"2026-11-18T10:04:57+00:00","dateModified":"2026-11-18T10:04:59+00:00","mainEntityOfPage":{"@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/"},"wordCount":401,"commentCount":0,"publisher":{"@id":"https:\/\/automaton-media.com\/en\/#organization"},"image":{"@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#primaryimage"},"thumbnailUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-header-2.jpg","keywords":["News (Global)"],"articleSection":["Game Development","News"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/","url":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/","name":"miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0 - AUTOMATON WEST","isPartOf":{"@id":"https:\/\/automaton-media.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#primaryimage"},"image":{"@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#primaryimage"},"thumbnailUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-header-2.jpg","datePublished":"2026-11-18T10:04:57+00:00","dateModified":"2026-11-18T10:04:59+00:00","breadcrumb":{"@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#primaryimage","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-header-2.jpg","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2026\/11\/20261118-75415-header-2.jpg","width":1309,"height":727},{"@type":"BreadcrumbList","@id":"https:\/\/automaton-media.com\/en\/news\/mihoyo-develops-ai-model-that-can-play-complex-games-like-honkai-star-rail-just-like-a-human-would-with-mouse-and-keyboard-inputs\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u30db\u30fc\u30e0","item":"https:\/\/automaton-media.com\/en\/"},{"@type":"ListItem","position":2,"name":"miHoYo develops AI model that can play complex games like Honkai: Star Rail just like a human would, with mouse and keyboard inputs\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/automaton-media.com\/en\/#website","url":"https:\/\/automaton-media.com\/en\/","name":"AUTOMATON WEST","description":"AUTOMATON is a website that covers the Japanese gaming world. We bring you the news on video games from Osaka and Tokyo.","publisher":{"@id":"https:\/\/automaton-media.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/automaton-media.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/automaton-media.com\/en\/#organization","name":"\u682a\u5f0f\u4f1a\u793e\u30a2\u30af\u30c6\u30a3\u30d6\u30b2\u30fc\u30df\u30f3\u30b0\u30e1\u30c7\u30a3\u30a2","url":"https:\/\/automaton-media.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2021\/04\/activegamingmedia_logo.png","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2021\/04\/activegamingmedia_logo.png","width":374,"height":190,"caption":"\u682a\u5f0f\u4f1a\u793e\u30a2\u30af\u30c6\u30a3\u30d6\u30b2\u30fc\u30df\u30f3\u30b0\u30e1\u30c7\u30a3\u30a2"},"image":{"@id":"https:\/\/automaton-media.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/AUTOMATON_ENG","https:\/\/www.youtube.com\/channel\/UCabvYnvuUUbbGUrxkaFRgSA"]},{"@type":"Person","@id":"https:\/\/automaton-media.com\/en\/#\/schema\/person\/2577a6aa569db379ace31f58d9313846","name":"Akira Sada","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/01\/pz-WVnDc_400x400-100x100.jpg","url":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/01\/pz-WVnDc_400x400-100x100.jpg","contentUrl":"https:\/\/automaton-media.com\/en\/wp-content\/uploads\/2024\/01\/pz-WVnDc_400x400-100x100.jpg","caption":"Akira Sada"},"url":"https:\/\/automaton-media.com\/en\/author\/akira-sada\/"}]}},"_links":{"self":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/75415","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/users\/93"}],"replies":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/comments?post=75415"}],"version-history":[{"count":3,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/75415\/revisions"}],"predecessor-version":[{"id":75427,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/posts\/75415\/revisions\/75427"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/media\/75424"}],"wp:attachment":[{"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/media?parent=75415"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/categories?post=75415"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/automaton-media.com\/en\/wp-json\/wp\/v2\/tags?post=75415"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}