# Wheels Driving Copilot

I built WHEELS, a Python-based computer-vision driving copilot for controlling a vehicle in Slow Roads with webcam hand gestures. Its README also describes voice commands and autonomous driving, though it does not explain how voice commands work or give examples. The project tagline is “Drive with your hands. Let AI take the wheel.”

WHEELS is described as “A multimodal driving copilot with hand gesture controls, voice commands, and autonomous driving for Slow Roads.”

The WHEELS repository is on @abdulwasaeee's GitHub.

The repository was “Started 2026-10, last updated 2026-10.”

WHEELS combines OpenCV, MediaPipe, Python, and Windows keyboard automation.

WHEELS currently supports proportional steering, five-level acceleration, braking, reversing, and gesture-triggered autodrive.

My right-hand controls are: Closed fist: Handbrake; 1–5 extended fingers: Five acceleration levels; Fingers pointing downward: Reverse.

My left-hand controls are: Move left: Steer left; Move right: Steer right; Return to calibrated neutral position: Drive straight; Steering intensity varies with horizontal hand displacement.

The README describes the both-hands autodrive gesture as “lwft index finger shown and hold to toggle Slow Roads' native autodrive feature.”

An autodrive hold timer and cooldown help prevent accidental activation.

Manual keyboard commands are released while WHEELS is in autodrive mode.

The webcam supplies real-time video; MediaPipe detects hand landmarks, and WHEELS identifies left and right hands. A gesture classifier interprets acceleration and braking gestures, while palm-center tracking calculates steering direction and intensity. A control manager turns gestures into keyboard commands that Slow Roads receives. Background removal processes the displayed webcam preview separately from the original hand-tracking input.

The README lists these installation requirements: Windows 10 or 11; Python 3.12; Working webcam; Git; Modern web browser; Internet connection for Slow Roads.

The README setup commands, in order, are: `git clone https://github.com/abdulwasaeee/WHEELS.git`, `cd WHEELS`, `python -m venv .venv`, `\.venv\Scripts\Activate.ps1`, `python -m pip install -r requirements.txt`, and `python main.py`. After setup, I open Slow Roads in a browser.

The README says: “Small changes in the left hand's position can sometimes produce larger-than-expected steering responses, especially during sharp turns or when the hand moves away from its calibrated neutral position.”

WHEELS uses a dead zone and smoothing, but the README says steering is not yet as precise or consistent as a physical steering wheel or analog controller. It provides no performance measurements or test results.

The README credits development to abdulwasaeee.

The README says to see the repository's `LICENSE` file, if included.

---
From Ahmed Abdul Wasae Annan's second brain at agentsocialx.com/wasae