Skip to content

sarthaknagoshe2002/Gesture-based-teaching-assistant

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

GESTURE BASED TEACHING ASSISTANT GUIDE

Checklist:

  1. Check whether the folder contains all the required files which include aimouse.exe, contact_us.exe, a folder named as ‘images’, word.bat, ppt.bat and paint.bat.
  2. Check whether the camera is accessible by your pc and is not utilized by any other application on your pc.
  3. Your pc must have good internet connection (recommended: - upload speed: 5mbps, download speed: 5mbps, ping/latency: <150ms).
  4. Make sure the Bluetooth earphone is connected to the pc.

STEP I:

Run the file named as aimouse.exe. STEP II:

Now, before the camera starts make sure your complete hand is in front of the camera so that the camera can capture your hand properly

STEP III:

Now, follow the gestures given below to perform the operations as per your wish!!!! Note:

  1. The images of gestures given below are of right hand so it is recommended to strictly use right hand only.
  2. make sure your hand is continuously present in front of the camera and properly visible in the video frame captured by the camera.
  3. While doing any operation in or to a file make sure the cursor is blinking in that file.
  4. Make sure there is adequate amount of lighting available in the room especially on your hand.
  5. The below gestures need not to be performed in the same sequence as given below!! You may perform any gesture at any point of time as per your requirement

GESTURES:

No. GESTURE OPERATION
1

- This gesture will activate the truly wireless mouse.

- Move your hand to move the mouse on the screen maintaining the position of the fingers same as the image besides.

- While using the truly wireless mouse make sure your hand is completely visible in the frame captured by the camera till the wrist.

2

- while the truly wireless mouse is activated raise your middle finger to stop the mouse at a required position.

- Make sure there is good amount of space between both the fingers as show in the image.

3

- After bringing the mouse to the desired position by following both the above steps slowly reduce the distance between both the finger to perform the click operation

- I.e., by raising the index and middle finger and bringing them together you can perform the click operation

- Make sure you don’t maintain this gesture for too long as it will result in multiple click

- Using the above point you can perform double, triple or multiple clicks

4

- Pointing the thumb towards left side will make the cursor move towards left if text is present.

- If a slideshow or ppt is being presented doing this gesture will help you to go the previous slide or page

- Make sure all the other fingers are tightly closed

- Maintain the same position of fingers as show besides as long as you want to go through previous slides or move your cursor more and more towards left

5

- raising the little finger will make the cursor move towards left if text is present.

- If a slideshow or ppt is being presented doing this gesture will help you to go the next slide or page

- Make sure all the other fingers are tightly closed

- maintain the same position of fingers as show besides as long as you want to go next slides or move your cursor more and more towards right

6

- Raise your thumb, middle and index finger and maintain good amount of distance between your index and middle finger to perform the copy operation

- Tip: you can follow the gesture number 3 to double click which will select the text where your cursor is at and then perform this action

- After this gesture is successfully performed the gesture number 7 must be performed immediately within 2 seconds

7

- Raise your thumb, middle and index finger and keep the middle and index finger tightly close to each other to perform the paste operation

- Make sure this operation is done within 2 seconds after the gesture number 6 i.e., the copy operation is performed for best results

- Tip: you can follow the gesture number 1,2&3 to shift the cursor from the current file to another file by single clicking on the other document

8

- Performed a wrong operation?? Want to undo what you just did?? Don’t worry we have the solution for it too!!!

- Just raise and stick your index, middle and ring finger close and bingo!! The undo operation is performed

- Maintain this gesture for a longer duration if you want to perform multiple undo

9

- Replicate the gesture shown in image besides to save a document, power point presentation, excel sheet or any particular document

- This operation won’t completely perform the save operation

- You will have to still enter the name of the file and select the location to complete the save operation

10

- Raising your thumb and little finger will initiate the voice assistant

- Whenever the voice assistant starts it will say “speak”

- Give your command verbally as

soon as the voice assistant says “speak”

- The voice assistant can only open word pad, paint or power point

- You just have to say “please open Microsoft paint” or “please open Microsoft word” or “please open Microsoft power point presentation” or “open ppt” or “open slides”

- The voice assistant is smart enough to understand even one-word commands like “word” or “paint” or “ppt” or “slides”

- The voice assistant remains active for very short duration, if you’re not able complete your command in this duration then repeat this gesture again

If you’re having any problem in: -

  • understanding this guide
  • running/starting the application
  • using the application
  • performing operations by gesture
  • using the voice assistant

Then Please contact us by running the application named as ‘contact_us’!!

Disclaimer:

I/We is/are not responsible for any harm caused to files or data of the device the application is being used in.

We strongly recommend to not run this application in any device containing crucial data or files.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published