Viewing The AI Vision Sensor Data on the EXP Brain

The AI Vision Screen on the EXP Brain can display real-time visual data captured by the AI Vision Sensor.

This screen allows users to view detected Color Signatures, AprilTags, and AI Classifications that are built into the system, providing immediate feedback on what the AI Vision Sensor sees in front of it.

Opening the AI Vision Sensor View

EXP Brain's screen is shown in the Home menu with the Right arrow button highlighted.

Press the Right button twice to highlight the Devices menu option.

EXP Brain's screen is shown in the Home menu with the Devices option selected. Devices is the third option in the Home menu, and the Check button is highlighted.

Press the Check button to select Devices.

EXP Brain's screen is shown in the Devices menu with the AI Vision sensor in Port 5 selected. The Left and Right arrow buttons are highlighted.

In the Devices menu, you will see connected devices on your robot.

Use the Left and Right buttons to select the port that the AI Vision Sensor is in.

EXP Brain's screen is shown in the Devices menu with the AI Vision sensor in Port 5 selected. The Check button is highlighted.

Then, press the Check button four times to access the AI Vision Screen view.

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu shows all of the identified Red objects and their locations as rectangles on the Brain's screen.

Press the Check button to cycle through the different views:

  • Red - Any objects that are the color red.
  • Green - Any objects that are the color green.
  • Blue - Any objects that are the color blue.
  • Yellow - Any objects that are the color yellow.
  • Tags - Any identified AprilTags.
  • Objects - Any identified AI Classifications.

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu shows all of the identified Red objects and their locations as rectangles overlayed onto the AI Vision sensor's video feed. The Left and Right arrow buttons are highlighted.

You can use the Left and Right buttons to toggle the display screen between showing the detected objects, the video feed, or the full-screen video feed.

Press the Right button to change the display to the AI Vision Sensor's video feed.

Pressing the Right button one more time will change the video feed to full screen.

To return to viewing detected objects, press the Right button a third time.

Viewing a Color Signature

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu shows all of the identified Red objects and their locations as rectangles on the Brain's screen. The Check button is highlighted.

Press the Check button to select a Color Signature (Red, Blue, Green, or Yellow).

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu shows all of the identified Red objects and their locations as rectangles on the Brain's screen. An identified Red object is shown and highlighted.

Position an object matching the chosen Color Signature within the AI Vision Sensor's field of view.

The object will appear on the screen automatically.

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu shows all of the identified Red objects and their locations as rectangles on the Brain's screen. On the left side of the screen a menu shows the selected Red object's position and size, and below a label indicates that the Arrow buttons can be used to select between Red objects.

The left side of the screen will update with the value of the Color Signature's Center X and Y coordinates, width, and height.

Go here for more information on how the AI Vision Sensor measures objects.

Viewing AprilTags

 

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu is changed to show AprilTags and their IDs and locations as rectangles on the Brain's screen. The Check button is highlighted.

Press the Check button until the Brain's screen shows Tags in the top-left corner.

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu is changed to show AprilTags and their IDs and locations as rectangles on the Brain's screen. An AprilTag is identified and highlighted on the Brain's screen.

Place an AprilTag marker within the view of the AI Vision Sensor.

The display will show detected AprilTags relative to the sensor's view.

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu shows all of the identified AprilTags and their IDs and locations as rectangles on the Brain's screen. On the left side of the screen a menu shows the selected AprilTag's position and ID, and below a label indicates that the Arrow buttons can be used to select between AprilTags.

The left side of the screen will update with the value of the AprilTag’s Center X and Y coordinates, as well as its ID number.

Go here for more information on how the AI Vision Sensor measures objects.

Viewing AI Classifications

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu is changed to show AI Classifications and their IDs and locations as rectangles on the Brain's screen. The Check button is highlighted.

Press the Check button until the Brain's screen shows Objects in the top-left corner.

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu is changed to show AI Classifications and their IDs and locations as rectangles on the Brain's screen. An Object is identified and highlighted on the Brain's screen.

Place an Object that matches one of the built-in AI Classifications within the view of the AI Vision Sensor.

The display will show the detected AI Classification relative to the sensor's view.

EXP Brain's screen is shown in the AI Vision sensor's menu. The menu shows all of the identified AI Classifications and their IDs and locations as rectangles on the Brain's screen. On the left side of the screen a menu shows the selected Object's position and ID, and below a label indicates that the Arrow buttons can be used to select between Objects.

The left side of the screen will update with the AI Classification's Center X and Y coordinates, as well as its ID number. 

Go here for more information on how the AI Vision Sensor measures objects.

For more information, help, and tips, check out the many resources at VEX Professional Development Plus

Last Updated: