1. VEX Library
  2. V5
  3. AI Vision Sensor
  4. Getting Started

Getting Started with the AI Vision Sensor with VEX V5

The AI Vision Sensor is an advanced sensor that allows your robot to see and interact with the world around it in ways that no other sensor can. The AI Vision Sensor captures visual information from a large field of view at high resolution, and is able to detect both two and three-dimensional objects. 

The AI Vision Sensor expands on the capabilities of the other sensors in the V5 Kit, with a wider and deeper field of view, and the ability to detect specific colors and combinations of colors within it. It can also detect AprilTags and a group of pre-trained objects. The sensor can report a wealth of data about what it detects, so you can locate an object or location in space using sensor data. 

 

 

What can the AI Vision Sensor detect?

This sensor can be configured to identify Color Signatures from various sources, including solid-colored three-dimensional (3D) objects and printed two-dimensional (2D) images. Additionally, it has the capability to learn and recognize combinations of colors, or Color Codes. The AI Vision Sensor can also detect AprilTags and AI Classifications. 

An AI Vision utility interface where a blue cube is being tracked. The left side displays the cube with coordinates X:174, Y:109, and dimensions W:88, H:100. On the right side, the color settings are labeled as Blue, with a hue range set to 10 and saturation range set to 0.20. There is a Set Color button and a color swatch showing the selected shade of blue. Below that is an option to add the color and a disabled button labeled Add Color Code.

Color Signatures are specified colors that the AI Vision Sensor will detect. The sensor identifies the pixels of that configured color within the field of view and reports data about that area. 

For more information on how to configure your AI Vision Sensor to detect specific colors, refer to Configuring Color Signatures with the AI Vision Sensor in VEXcode V5.

An AI Vision utility interface tracking two cubes, one blue and one green, labeled as

Color Codes are sequences of Color Signatures. They allow the AI Vision Sensor to identify and distinguish specific patterns of colored pixels.

For more information on how to create Color Codes, refer to Configuring Color Codes with the AI Vision Sensor in VEXcode V5.

The image shows three AprilTags being tracked by a vision system. The left tag is labeled ID:0, with coordinates X:110, Y:96, W:41, H:41, and an angle of A:350°. The middle tag is labeled ID:3, with coordinates X:187, Y:180, W:57, H:57, and an angle of A:1°. The right tag is labeled ID:9, with coordinates X:237, Y:89, W:38, H:38, and an angle of A:3°. Each tag is outlined, indicating its tracking by the system.

AprilTags are visual markers with specific patterns that the AI Vision Sensor can detect and identify. 

For more information on AprilTags and how to enable their detection, refer to Using AprilTags with the AI Vision Sensor in VEXcode V5.

The image shows four objects being tracked by a vision system: two balls and two rings. The red ball is labeled with coordinates X:122, Y:84, dimensions W:67, H:66, and a score of 99%. The blue ball has coordinates X:228, Y:86, dimensions W:70, H:68, and a score of 99%. The green ring is labeled with coordinates X:109, Y:186, dimensions W:98, H:92, and a score of 99%. The red ring has coordinates X:259, Y:187, dimensions W:89, H:91, and a score of 99%. Each object is outlined with a white box.

AI Classifications are specific objects that the AI Vision Sensor has been trained to be able to detect. These include VEX classroom objects, like Buckyballs and Rings, as well as competition game elements.

For more information on what AI Classifications can be detected by the AI Vision Sensor and how to enable their detection, refer to AI Classifications with the AI Vision Sensor in VEXcode V5..

Getting Started with the AI Vision Sensor in Your Setting

Use the links below to help you as you are getting started with the AI Vision Sensor.

Want to learn more?

Learn more about coding with the AI Vision Sensor with the articles in this section of the VEX Library. 

For more information on the individual Blocks or text-commands for the AI Vision Sensor, visit api.vex.com.

For more information, help, and tips, check out the many resources at VEX Professional Development Plus

Last Updated: