Version 1.3.2
Robotics offers an efficient way for assistive devices to maintain many errands. In this study it is aimed to present a proof of concept robotic study that is called TeleTouch. TeleTouch is a robotic system that allows mimicking user’s finger motions/gestures to be transferred in a desired remote location with in an acceptable delay. In the implementation Leap motion sensor, Raspberry Pi, and Arduino systems are used. 3D printers printed Hand model is actuated by Arduino system which is responsible for driving the servo motors connected the hand model. Raspberry PI is used not only for transferring camera view of the hand model to the controlling remote system but also it is used for transferring to finger attributes to the Arduino system. A software is developed in .Net platform to gather the user’s attributes of the fingers from leap motion sensor system. Delay times of the local and remote system investigated and understood that proposed system successfully transfer motion in almost real time
This video gives the general purpose and construction of the project.
What things you need to install the system
| Material | Count |
|---|---|
| Servo Motors | 5 |
| Raspberry Pi | 1 |
| Tele-Board V1.3.5 | 1 |
| Arduino Nano | 1 |
| Wooden Plates | 1 |
| Power Supply (5V 10A) | 1 |
| 3D Prints Hand | 1 |
First of all we should print all of the parts from 3D printer. In first try we used model from bq3D.
After mounting each servo motor, let's put in the system. You should watch out the aligment of the motors.
The current circuit so basic and so easy to control the sytem. We designed a PCB that you can you use in these project. It uses Arduino Nano as a controller. This board can drive 5 servo motor individually. Also it has got humidity(DHT11), temperature(LM35) and light intensity sensors. Also card includes two N-Type transistor that user can use in their applications. Also board has got a Sensorboard connector that user can solder and use.
- Tested
Project construction is planned in three basic stages. The first stage includes the user interface software. In the second step, the finger and hand values can be accessed via the internet and at the same time the Python code is written in order to transfer the image on the TCP / IP protocol. Finally, the Arduino platform was chosen to read the control and sensor values of the servo motors. First of all, the user attaches Leap Motion to his computer. Then it starts the application, which is prepared in C #. When the user moves his / her hands and fingers; Hand information is read and interpreted by the application. Then the user enters the IP address of the device he wants to connect to and then connects to the opposite device (to server). The connected device is actually a small computer. The preferred card in this project is Raspberry Pi. Alternatively, cards such as BeagleBone may be used. The most important feature of these cards is to have an operating system (Linux) embedded in them. With this operating system it is possible to run complex programs that microcontrollers can not run. In this context, the Python code in Raspberry Pi responds to requests to connect over IP (clients). After the connection, the Arduino card connected to Raspberry Pi reads the sensor values via the serial port and the media information is sent to the interface. These values are plotted in real time on the interface. Hand and finger data from the interface are also sent to Arduino in the same way. These are converted to PWM waves for robot hand control and are provided for hand movement. In addition, the user interface from the camera on the robot hand goes to the camera image and the media data read from the sensor.
To use Leap Motion in the project, the C # programming language is preferred. It is worth pointing out that C # is a big influence of the SDK in preference. Also user interface developed from .Net platform.
In the project, the Python language is preferred for the program that will run on a Linux(Raspberry Pi) computer for communicating with computer over TCP. The reason for this is that Python is easy to use, has a large user population.
To setup our program to Raspberry Pi you should install OpenCV. After that you can start program like that
workon cv
cd Desktop `#Your Directory`
python proje.py- Musa Sadık Unal - Initial work - musaunal.com
- Abdurrahman Unal - *Initial work"
- Ersin Erturk - Initial work
- 3D VR Support
- Wrist Servo
This project is licensed under the MIT License - see the LICENSE.md file for details
- Thanks to Alperen Caliskan for his supports