Tencent IEG open source AI SDK: automatic testing of chicken eating and MoBa games

Yueyue 2021-02-23 15:32:26
tencent ieg open source ai

Almost Human reports

edit : Chen Ping 、 Devil

SDK It can also play games automatically ? This SDK somewhat 「 cool 」.

 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

In recent days, , Tencent Entertainment (IEG) Open source a project called GAME AI SDK Automated test platform for , The platform encapsulates a variety of tools for developers to use , Currently, the types of games supported are Parkour 、 Eat chicken 、 Shooting category 、MOBA Class etc. .

Project address :https://github.com/Tencent/GameAISDK

 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

Platform built in 「 Cool run every day 」 Example . The picture on the left shows the untrained random action , The picture on the right shows the effect of training .

SDK( Software development kit ) It's usually a software engineer for a specific package 、 software framework 、 Hardware platform 、 Operating system and other development tools that can be used to create application software .

It seems a little abstract . In the actual project , We just need to remember ,SDK It's provided by mobile game channel , Integrated user login 、 Community function 、 Social sharing 、 Function module of data background statistics function . Access SDK after , Game manufacturers and channels should be right SDK Package to test , Only after passing the test can we go online .

Look at the cool running picture shown above , Do you want to try chicken 、 Shooting game experience ? This open source project can meet your needs , It supports users to access projects and secondary development .

AI SDK platform

AI SDK The platform is a platform for developing games based on game images AI Open Source Toolkit for . It's mainly done UI testing 、 In game element recognition 、AI Algorithm (DQN、IM) And so on . Developers can complete the game automation test based on this toolkit .

At present, the game types supported by the platform are Parkour 、 Eat chicken 、 Shooting category 、MOBA Class etc. . It can replace the artificial automation of the game scene in specific scenarios , Reduce the manpower investment in game scenario testing .

The toolkit mainly includes AI SDK、AI Client、SDKTool( Profile tool ) These parts .

SDKTool Help us generate game specific AI SDK Required profile . For example, in the course of the game , Action interaction is needed in the whole process UI、 Game elements that need to be identified, etc .AI The information used in the development process can come from game images (AI Client obtain ) Or other data .AI SDK Able to automate the game UI Operate and enter the game scene , Operate the mobile phone to play games like a player .

Function introduction

GAME AI SDK The platform has the following functions :

Provides a variety of image recognition algorithms , Identify key feature data in the game scene , Such as the skill state in the game scene 、 Button position 、 Target location, etc .

Provide imitation learning and reinforcement learning AI Algorithm , It can be directly used in training game scenes AI.

It provides a complete set of sample collection 、 Image annotation tool .

AI SDK Module introduction

AI SDK It mainly includes AI Client modular 、MC modular 、IO modular 、UI modular 、GameReg modular 、AI modular .

 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

chart 1:AI SDK Module diagram .

AI Client It mainly interacts with the mobile terminal , Get game images , And implement UI or AI Output action ;

IO Module and AI Client Interaction , As AI SDK Data input and output control ;

MC Module and IO Module interaction , Distribute data to AI SDK Back end UI and AI modular , And do some business logic management control ;

UI Module based on game image , Identify what needs to be done UI operation ;

GameReg Module based on game image , Identify the numbers in the game scene 、 Blood strip 、 Objects and other elements ;

AI Module based on the identified game elements , according to AI Algorithms perform business logic .

 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

chart 2: Architecture diagram .

The deployment environment

function AI SDK Medium demo, First you need to install the dependency , And then local PC Mobile phone connected to mobile phone ( Or mobile phone emulator ), adopt AI Client Real time collection of mobile phones ( Or mobile phone emulator ) Game screen of , And to the AI Service processing . hold AI The action result of service processing is fed back to the connection PC On my cell phone , Complete the interaction of actions .

 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

chart 3:AI SDK Interaction diagram with mobile phone .

Deployment depends on the environment

The deployment dependent environment is mainly installation AI SDK、SDKTool( Configuration file generation tool )、AI Client The environment depends on .

The project provides two kinds of operating system deployment process .

Ubuntu: at present SDK The toolkit runs on 16.04 Of 64 position Ubuntu On the system , The deep learning framework used is TensorFlow, So before you use it, you need to install the dependent ubuntu The system and the corresponding dependent third party toolkits , Such as TensorFlow、OpenCV、protobuf etc. .

The environment mainly depends on nvdia-cuda 9.0、cudnn 7.0、opencv 3.4.2、protobuf 3.2.0、android adb、poster Toolsets and other dependency packages . Please refer to :https://github.com/Tencent/GameAISDK/blob/master/doc/environment/InstallStepByStep.md.

Windows:SDK The package comes with the dependent package file to be installed 「requirements.txt」, therefore windows Next, just install 「requirements.txt」 Dependency in . Please refer to :https://github.com/Tencent/GameAISDK/blob/master/doc/environment/SDKToolEnv.md.

Besides , The project also introduces the profile tool SDK Tool、 Project access 、 Secondary development and debugging skills , Please refer to the project link for details .

Reference link :




  1. What are the rights and interests of enterprise Baijia?
  2. Enterprise hundred blue V authentication account, seven supporting enterprise functions
  3. Excel menu bar toolbar suddenly disappeared, how to do?
  4. 百家号打造“匠心计划”,百亿流量针对企业进
  5. 性能表现高于预期的国产芯,零刻LZX迷你电脑主机使用评测
  6. 特殊时期网约车哪个最靠谱 滴滴享道等5款打车软件实测
  7. 小度真无线智能耳机测评:把智能放进耳朵
  8. 「榜单」12月手机性价比排行出炉 近期买机必看
  9. 企业百度百家号蓝v认证账号,开启商业带货模式
  10. 如何利用百度百家号蓝v认证账号进行引流涨粉以及推广公司品牌
  11. 新媒体代运营的优势有哪些?巨推传媒告诉你
  12. 企业百家号蓝v认证账号怎么注册,需要哪些材料
  13. 企业百家号认证流程是什么样的?
  14. 办公学习好助手 咪咕讯飞智能笔记本评测
  15. 微信订阅号改版,公众号怎么玩才能活下来?
  16. 云南一位奶奶遗物里有张老照片,惊现“神秘代码”!内容破译后意外走红
  17. 云主机还能这么玩?SugarHosts香港云主机最新体验分享
  18. Baijia creates a "ingenuity plan", with 10 billion flows for enterprises
  19. Performance is higher than expected domestic core, zero engraving LZX mini computer host use evaluation
  20. Which is the most reliable online car Hailing software in special period
  21. Small true wireless smart headset evaluation: put intelligence into the ear
  22. 《塞尔达传说:织梦岛》8.6分:一场时空穿梭,重温26年前的感动
  23. 网络营销方式之QQ群营销
  24. 百度百家号有哪些账号权益,通过权益能获得哪些好处?
  25. "List" of mobile phone cost performance in December
  26. 这个已经纵横了各平台7、8年的骗局,还有人正不断中招
  27. 阿里云免费6个月的云服务器测评:2核4G1M
  28. Enterprise Baidu Baijia blue V authentication account, open business mode with goods
  29. How to use Baidu Baijia blue V authentication account to promote the company's brand
  30. What are the advantages of new media agent operation? Giant media tells you
  31. How to register the company's blue V account and what materials are needed
  32. What is the certification process of enterprise Baijia?
  33. Smart notebook evaluation of Migu iFLYTEK
  34. 企业百度百家号蓝v认证账号,开启直播带货功能
  35. 周围竟然没人能回答 无人机到底值不值得买?
  36. IT之家网友亲测:VBox VS VMWare,虚拟化技术哪家强
  37. WeChat subscription number is revised, how can official account be maintained?
  38. There is an old photo in the remains of a grandmother in Yunnan, which reveals the "mysterious code"! Unexpected popularity after content decoding
  39. Can virtual machine still play like this? The latest experience sharing of sugarchosts in Hong Kong
  40. 快手推广宝鸡代理
  41. 手机屏幕密码忘记了怎么办?简单几步就完事儿!
  42. 微软Surface Laptop Go评测:低价笔记本电脑
  43. Legend of Zelda: Dream Island 8.6 points: a time and space shuttle, revisiting the touch of 26 years ago
  44. 抗雾霾哪款最实用,快看这16款空气净化器口碑!
  45. 百度百家号企业蓝v账号打通裂变新模式,提升品牌宣传力度
  46. QQ group marketing of network marketing
  47. What account rights and interests does Baidu Baijia have and what benefits can it obtain through rights and interests?
  48. This scam, which has been going on all platforms for 7 or 8 years, is attracting more and more people
  49. Alibaba cloud's 6-Month Free Evaluation of cloud server: 2-core 4g1m
  50. Enterprise baidu hundred blue V authentication account, open live with goods function
  51. 入门智能音箱哪家强?天猫精灵X1、小米AI音箱对比评测
  52. 企业百家号蓝v认证,助力企业构建私域流量
  53. 莱昂纳德的密保工作太强!他都不知道小卡要去哪
  54. 腾讯IEG开源AI SDK:自动化测试吃鸡、MOBA类游戏
  55. Nobody around can answer whether UAVs are worth buying or not?
  56. VBox vs VMware, which is the best virtualization technology
  57. 2019年度APP分类排行
  58. 通过WAP,真正实现不受时间和地域约束的移动电子商务
  59. 智能手表品牌哪款好?6款性价比高智能手表评测!
  60. 米家投影仪 72 小时体验,你最该关心这 6 个问题