This was my first completed project. Made for the company Pormade Portas, with the objective of using it in exhibitions at fairs. But above all, done as a study project, as it was done during a learning program within the company.
- Unity;
- Python;
- cvzone.HandTrackingModule, Python's library;
- Tutorial on Youtube 3d Hand Tracking in Virtual Environment | Computer Vision
With the use of a webcam, the script HandTracking.py tracks your hand through HandDetector. The 21 coordinates landmarks of your hand are stored in a list, together another list, that store how much fingers of your hand are rise up. All is passed to a server made with python, then Unity can acess this data.
By script UDPReceive.cs Unity receive the coordinates of list in python.
In Unity, the 21 landmarks are separetad at 21 objects, each object receive the position of one landmark of coordinates, this make the objects accompany your hand movement in real time.
After acess all data, other scripts at Unity check each movment and fingers rise up, to capture diferent gesture.
Exemple: closed hand, opened hand. One, two, tree fingers rise up.
One scene at Unity, has various variations of doors, and with each gesture the person can interact making the door:
- Open;✋
- Close;🖖
- Separate each part contained in the door frame;✌️
- Put together each part;☝️
- Spin around the door;✊
- Apply zoom;🤏
- Decrease zoom.🤏
- Next door;👋
- Previus door.👋
- The 3D objects and textures from ambient weren't made by me. All are Unity assets;
- The doors and logo were made by another Pormade Portas collaborator's;
- The texture on the wall picture is here: imagem
