Choose a Sensor for Unreal Engine Simulation

In Automated Driving Toolbox™, you can obtain high-fidelity sensor data from a virtual environment. This environment is rendered using the Unreal Engine^® from Epic Games^®.

Simulating models in the 3D visualization environment requires Simulink^® 3D Animation™.

The table summarizes the sensor blocks that you can simulate in this environment.

Sensor Block	Description	Visualization	Example
Simulation 3D Camera	Camera with lens that is based on the ideal pinhole camera. See What Is Camera Calibration? Includes parameters for image size, focal length, distortion, and skew Includes options to output ground truth for depth estimation and semantic segmentation	Display camera images by using a Video Viewer or To Video Display block. Sample visualization:	Design Lane Marker Detector Using Unreal Engine Simulation Environment
		Display depth maps by using a Video Viewer or To Video Display block. Sample visualization:	Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation
		Display semantic segmentation maps by using a Video Viewer or To Video Display block. Sample visualization:	Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation
Simulation 3D Fisheye Camera	Fisheye camera that can be described using the Scaramuzza camera model. See Fisheye Calibration Basics Includes parameters for distortion center, image size, and mapping coefficients	Display camera images by using a Video Viewer or To Video Display block. Sample visualization:	Simulate Simple Driving Scenario and Sensor in Unreal Engine Environment
Simulation 3D Lidar	Scanning lidar sensor model Includes parameters for detection range, resolution, and fields of view	Display point cloud data by using pcplayer within a MATLAB Function block. Sample visualization:	Design Lidar SLAM Algorithm Using Unreal Engine Simulation Environment
		Display lidar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:	Visualize Sensor Data from Unreal Engine Simulation Environment
Simulation 3D Probabilistic Radar	Probabilistic radar model that returns a list of detections Includes parameters for radar accuracy, radar bias, detection probability, and detection reporting	Display radar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:	Simulate Vision and Radar Sensors in Unreal Engine Environment Visualize Sensor Data from Unreal Engine Simulation Environment
Simulation 3D Vision Detection Generator	Camera model that returns a list of object and lane boundary detections Includes parameters for detection accuracy, measurement noise, and camera intrinsics	Display vision coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:	Simulate Vision and Radar Sensors in Unreal Engine Environment
Simulation 3D Ultrasonic Sensor	Ultrasonic sensor model that returns detections as range values. Includes range parameters for object-only detection reporting as well as object and range detection reporting.	Display ultrasonic range coverage areas and range detections by using the Bird's-Eye Scope. Sample visualization:	Build Occupancy Map Using Simulation 3D Ultrasonic Sensor