The AI Model Configuration page is designed to equip your simulation with a suite of advanced AI capabilities. Users can tailor their simulation by selecting from a variety of AI models, each serving different aspects of robotic perception and navigation. For a full understanding of the AI models available, refer to our AI Models section.

​
Model Categories and Selection

Below are the available categories of AI models. Within each category, select the models that will be incorporated into your simulation:

​
Perception

The perception models enhance the robot’s ability to detect and understand its surroundings. These include:

  • Object Detection: Models that identify and locate objects within the simulation environment.
  • Image Segmentation: Models that partition an image into multiple segments to simplify and change the representation of an image into something more meaningful.
  • Monocular Depth: Models that estimate the depth from a single camera feed, providing 3D perception from 2D images.
  • Vision Language Models: Models capable of interpreting the visual scene to answer qualitative and quantitative questions.
  • Visual Odometry: Models that estimate the robot’s path and orientation based on image data.
  • Point Tracking: Models that track the movement of specific points in the scene as the robot navigates.
  • Point Matching: Models that match points between two images to determine the relative position of objects.
  • Optical Flow: Models that measure the motion of objects relative to the camera, useful for determining the speed and direction of moving objects.

​
Safety

Safety models are designed to predict and avoid hazardous scenarios within the simulation:

  • Time to Collision: Models that estimate the time before a potential collision could occur.

Navigation models focus on guiding the robot through the environment, enabling it to move and react to visual cues:

  • Visual Servoing: Models that control the motion of the robot by using visual feedback to direct its path.

​
Configuring Your Selection

You can combine multiple models from different categories to create sophisticated and layered AI behaviors within your simulation.

To configure your AI model selection:

  1. Check the box next to each AI model you wish to include from the listed categories.
  2. Follow the link to the specific model’s documentation for detailed configuration instructions and use-case examples.
Selecting the appropriate AI models is crucial for achieving the desired outcomes in your simulation. Ensure that you understand the function and application of each category to make informed choices.

Once your AI models are selected and configured, proceed to finalize your simulation setup and initiate the session to observe the models in action.

Was this page helpful?