Full-Stack Cyber-Physical Design

A resilient, low-latency decoupled architecture combining industrial microcontrollers with high-concurrency cloud dashboards.

🖥️ Software Stack

Three.js 3D Digital Twin WebGL / 60 FPS

Interactive 3D isometric representation of warehouse racks, aisle buffer boundaries, live robot models, and delivery drop bins.

Flask REST & SSE Backend Python 3.14

High-speed event broker synchronizing fleet telemetry, ERP order queues, and OTA binary deployments over local port 5000.

Embedded MQTT Broker Port 1883

Decoupled pub/sub telemetry transport running locally with sub-15ms message routing to fleet microcontrollers.

Hugging Face YOLOv8 Vision PyTorch / TinyML

Lightweight convolutional neural network for barcode detection, Halal logo verification, and conveyor obstacle identification.

🤖 Hardware Specifications

AMR-V3 Mobile Chassis Differential Drive

Industrial aluminum chassis with 20kg payload capacity, dual optical encoders, and 3-hour continuous run-time on LiFePO4 batteries.

4-DOF Articulated Arm Nema-17 Steppers

High-precision robotic manipulator with soft silicone suction and mechanical gripper for damage-free food package picking.

Dual ESP32 Microcontrollers 240 MHz Dual Core

ESP32-S3 for kinematics, trajectory calculation, and OTA updates; paired with an ESP32-CAM module for optical verification.

LiDAR & ToF Sensors Sub-cm Accuracy

360-degree 2D laser LiDAR combined with front and rear Time-of-Flight sensors for collision-free aisle traversal.

ESP32-CAM & Motor Controller Pinout

Component Pin / Interface Protocol Function Description
ESP32-CAM Sensor GPIO 0, 2, 4, 12, 13, 14, 15 DVP Camera Bus OV2640 2MP Image Sensor for Halal logo validation
Left Stepper Driver GPIO 18 (STEP), GPIO 19 (DIR) PWM / Digital Differential drive left wheel velocity and distance control
Right Stepper Driver GPIO 21 (STEP), GPIO 22 (DIR) PWM / Digital Differential drive right wheel velocity and distance control
4-DOF Arm Servos GPIO 25, 26, 27, 32 Hardware PWM Articulated shoulder, elbow, wrist pitch, and gripper grip
ToF LiDAR Sensor GPIO 33 (SDA), GPIO 35 (SCL) I2C Bus (400 kHz) Front obstacle detection and precise rack stop distance