Plugins Roadmap & Ideas

There's far more that would be useful than can be done all at once. This page contains information on what might be useful to have, and current status of various projects.

Feel free to make edits with ideas and suggestions, add commentary below the table, or vote by initialing with your @handle in the rightmost column.

Title	Problem	Solution	Votes
grabPosition	when grabbing, palm position flies all over the place, making it difficult to select one item	analyze the closed fist, and figure out how to calculate the intended position equvilent to palmPosition on a flat hand. Then use grabstrength to lerp the two points.
Transform	Can't move hand around in scene, place multiple hands in scene, etc.	Allows any hand in the frame to be transformed in position, rotation, and scale.,Full THREE.js support with rotation matrixes, quaternions, Vetoror3s, and so on.
handSplay	Need trivial "activation" gesture, to cover the opposite side of the activation space from pinchStrength.	Gives a measurement of how stretched out and flat a hand is
relativeMotion	This is essential for natural user interfaces when combining LeapJS with existing 2d UIs. It allows a layer of abstraction required for screen interface density.	Adds two methods to the hand: relativePosition and recalibrate.,When recalibrated, the 3d coordinate system will be rotated to match the current orientation of the hand.
playback	It can be hard to explain how a Leap app should be used, especially to someone w/o a leap	Capture frame data while the user is interacting with their app, allow them to save it or send to codepen, host in our cloud.
interactionZone	Its extremely easy for users to leave the FOV of the Leap, get frustrated, etc.	Make it trivial for developers to paint 2d or 3d lines on to the screen, and access that as API data, to give users feedback when they're getting near the edges.
grapher	Visualizing Leap Data is really hard. It is great to be able to both print and visualize streaming data.	Build a chrome inspector plugin and add two new api commands to the chrome console: console.graph and console.display which present streaming data in an easily consumed form.
filter	Working with the Leap Data can be hard. When building apps, we need an intuitive understanding of data-quality, and the noise reduction and filtering techniques required to make data good.	Build a plugin with a few different built-in tunable filters: rolling-average, exponential, outlier reduction, and so on. Be able to easily tune these, and see how an app responds.
motionDetector	Working with motion data can be pretty foreign. The ability to detect when one motion stops would be really useful when designing gestures and interactions.	Build an API which says: motion started, motion stopped; gives curvature, speed, endpoints, and so on. Be able to work with an average motion quality, and discard any that don't fit.
riggedHand	It's hard to know how the leap perceives the hand while an app is being used.	Add a virtual rigged-hand to the screen - large or small, transparent or opaque, etc.
pinchFinger	Don't know which finger is pinching under pinchstrength	Check for closest finger tip, return that as pinchFinger on the hand.
dat.gui integration	Moving objects/settings in 3d scenes/threejs is a tedious process of guess & test.	Select objects or parameters one at a time, and use the leap with pinching to position them in space
Networking support	It would be great to be able to stream leap-data live, and allow interaction on web pages and in games	Build a library founded on the technology of playback, which allows stream data to be compressed and shared between multiple people. Use WebRTC with a fallback to websockets.
chrome inspector	Leap works with streaming vector3s, which is not seen a lot on the web. This makes debugging relatively hard.	Build a chrome inspector extension tab which will allow standard leap-debugging on any web-page. Include 3d visualizer with hand, 2d data graphs, plugin introspection, automatic backgrounding while debugging, drop-in playback integration, etc..

Markdown generated with http://www.tablesgenerator.com/markdown_tables