The VR Rover in Rover Rescue is equipped with built-in AI technology that enables it to detect game elements and use that information to better navigate its virtual world. This data can be visualized and used in various ways within the Rover Rescue Playground and game play.
How is this an example of Artificial Intelligence (AI) technology?
The built-in Artificial Intelligence (AI) technology in the VR Rover enables it to detect objects and report attributes about them. Sensors, like a Distance Sensor, can detect an object and its location but do not have the intelligence to report any information about that object. AI is able to not only detect the presence and location of an object, but can also use its intelligence to identify the object and other important attributes about it.
In Rover Rescue, the VR Rover’s built-in AI has been pre-trained to be able to detect game objects and tell the difference between them. For instance, the AI will detect and name ‘obstacles’, ‘enemies’, and ‘minerals’ as they come within detectable range of the VR Rover. The AI uses the detected size of the object to determine its distance from the VR Rover, and continuously reports that information.
Forms of AI in the VR Rover
The VR Rover is equipped with two main forms of AI: detect and sight.
AI Detect
“Detect” is used to identify what is around the VR Rover for 360 degrees, within a radius of 800 millimeters (mm).
The VR Rover can detect minerals and enemies, and can differentiate between the two. The detect radius is indicated by the yellow circle in the image to the left.
AI Sight
“Sight” is used to detect what is in front of the VR Rover within a 40 degree field of view and a range of 1000 millimeters (mm).
The VR Rover can see minerals, enemies, obstacles, hazards, and the Base, and can differentiate between them. The AI sight will report more information about what it sees, like the distance and angle to minerals or the health points of an irradiated enemy. The field of vision is estimated with the yellow lines in the image to the left.
Visualizing AI information in Rover Rescue
There are two ways to visualize the information the built-in AI is reporting within the Rover Rescue Playground window: the mini map, and the AI visualization on the field of play.
The Mini Map
When the mini map is present in the Rover Rescue Playground window, it will show the VR Rover’s relative position to the playable field and the objects its AI has identified.
The AI information visible on the mini map includes the detect radius and field of vision, and the elements that can be sensed within those ranges.
Detect Radius
The purple circle around the VR Rover (as highlighted with the red arrow in this image) indicates the detect radius.
Minerals and enemies within this range can be sensed using AI detect.
Field of Vision
The purple translucent cone projected from the front of the VR Rover (as highlighted with the red arrow in this image) indicates the field of vision, or where the VR Rover can effectively “see.”
Game elements within this range can be seen, and more information about these objects will be displayed on the field of play.
AI Visualization
AI Visualization
The AI Visualization on the field of play can be turned on and off by selecting the button in the lower right corner of the Playground window.
When turned on, the AI information will highlight detected game elements and display their name and relevant attributes—like distance or health points.
The attribute information will only be displayed when game elements are within the field of vision and 1000 mm sight range of the VR Rover. When they are out of range, it will not be displayed.
Minerals indicated by a glowing highlight and a ‘Mineral’ label.
The distance and angle to minerals is also displayed, and will change in real time as the VR Rover moves around the alien environment.
Irradiated enemies are indicated by a glowing highlight and an ‘Enemy’ label.
The distance and angle to the enemy is displayed, and will change in real time as the VR Rover and the enemy move in relation to one another.
The level and health of the enemy is also displayed. The higher the level, the greater the health points of an enemy. The strength of the absorb needed to neutralize an enemy correlates to its level and health.
Obstacles are indicated by a glowing highlight and an ‘Obstacle’ label.
The distance to the obstacle is displayed, and will change in real time as the VR Rover moves around the alien environment.
Using AI information in projects
The information from the VR Rover’s built-in AI can be used in projects to help navigate to minerals, detect enemies, avoid obstacles, and more. There are several ways that AI data can be used in a project.
Example projects can be used as a starting point for your code. See this article for more information on accessing and using example projects in VEXcode VR.