نظام ذكي لاكتشاف وتحليل الحفارات

AI-Powered Excavator Detection and Analysis Using YOLO and Google Gemini

This project uses YOLO-based detection and Google Gemini AI to monitor, track, and analyze excavators in video footage, generating structured reports for industrial applications.

Project Overview

The Excavator Detection and Analysis System leverages YOLO object detection and Google Gemini AI to identify, track, and analyze excavators in videos. It extracts images, determines working status, color, and company branding, and stores the information in structured reports. Designed for construction, mining, and industrial monitoring, it automates tracking and supports data-driven decision-making.

Key Features

Excavator Detection & Tracking

• 🛠️ YOLO-based detection to identify excavators in video frames.
• 🆔 Assigns unique track IDs to prevent duplicate processing.

Image Processing & Analysis

• ✂️ Crops detected excavator images for further analysis.

Google Gemini AI Integration

• 🧠 Determines working status (active/standby).
• 🎨 Recognizes excavator color.
• 🏷️ Extracts company branding or logo.

Data Logging & Report Generation

• 📝 Stores AI analysis in structured text reports.
• 📸 Saves cropped excavator images for verification.

Performance Optimization

• 🧵 Multithreading enables asynchronous processing for real-time performance.

Interactive Visualization

• 📺 OpenCV GUI shows real-time video with bounding boxes, track IDs, and labels.

Technology Stack

• 🐍 Programming Language: Python
• 🎥 Computer Vision: OpenCV
• 🧠 Object Detection: YOLO (Ultralytics)
• 🤖 AI Analysis: Google Gemini AI
• 🧵 Performance: Multithreading
• 💻 Visualization: cvzone

Use Cases

• 🏗️ Construction Site Monitoring – Track excavator activity and generate usage reports.
• 🚜 Automated Fleet Management – Identify company-owned machines from videos.
• ⛏️ Mining & Heavy Equipment Analysis – Monitor machine operations and optimize resources.
• 🛡️ Surveillance & Compliance – Verify active or idle status in restricted zones.

Conclusion

This AI-powered Excavator Detection and Analysis System integrates YOLO object detection, image processing, and Google Gemini AI to automate monitoring and reporting of industrial excavator activities. It enhances real-time tracking, structured data analysis, and informed decision-making for construction and mining operations.