tello_drone_control​led_and_simulation_​objectdetection_usi​ng_

This project integrates the control of a Tello mini-drone with MATLAB, using advanced features such as object detection with and YOLO

Project Title

The Digital Twin of a Drone

Description

This project integrates the control of a Tello mini-drone with MATLAB, using advanced features such as object detection with TFLite and YOLOv3 models in Simulink. It also establishes OPC UA communication between MATLAB and Prosys for data transfer and control, and aims to create a Digital Twin of the drone for real-world simulation. The project integrates AI/ML analysis and ensures secure, reliable data flow using OPC UA and WiFi communication protocols.

Prerequisites

• MATLAB software installed.
• Tello mini-drone connected to the MATLAB environment.
• Basic knowledge of MATLAB programming and control systems.
• Familiarity with Simulink for system modeling and simulation.
• Understanding of OPC UA communication and implementation.

Installation

1. Install MATLAB from the MathWorks website.
2. Connect the Tello mini-drone to MATLAB using the appropriate communication protocols.
3. Set up the required toolboxes for advanced Simulink modeling and AI/ML implementation.
4. Ensure a stable network connection for OPC UA communication.

Project Tasks

Tello Mini-Drone Control

• Implement basic controls for the Tello mini-drone (takeoff, landing, movement).
• Collect height and orientation data from the drone for analysis.

Object Detection with TFLite and YOLOv3 Models in Simulink

• Integrate TFLite model for object detection in Simulink environment.
• Explore YOLOv3 model adaptation for custom dataset analysis in Simulink.

OPC UA Communication and Data Transfer

• Establish secure communication between MATLAB and Prosys OPC UA server.
• Implement data transfer from the server to MATLAB for further analysis and control.

Digital Twin Creation and Simulation

• Develop a Digital Twin model mirroring the real-world drone movements.
• Ensure synchronization between the Digital Twin and the physical drone for accurate simulation.

AI/ML Integration and Data Analysis

• Apply AI/ML techniques for advanced data analysis and decision-making processes.
• Use data from the drone and the Digital Twin for predictive analysis and control optimization.

Secure Data Flow with OPC UA and WiFi Communication

• Implement secure and reliable data flow protocols using OPC UA and WiFi communication.
• Monitor data transfer for any potential security breaches or reliability issues.

Media

TFLite Object Detection in Simulink

YOLOv3 Model Integration in Simulink

Simulink Model Diagram


Project Demonstration Video

OPC UA Communication Setup