AR Copy Paste - Text Proto

An AR+ML prototype that extract text from your surroundings using MLKit and interactively transfer to desktop using ARCore & Electron.

For more technical informations: Thread with technical insights

Warning:

This is a highly experimental research prototype (I can only provide minimal support)
If you're looking for an app based on this research: arcopypaste.app

Setup & run

This prototype runs as 2 separate modules:

Mobile - A native Android mobile app
Desktop - A cross platform desktop app made with Electron

Thanks and aknowledgements

Ajeet Kumar Medium Post about Text Detection with MLKit