Skip to content
forked from noufilsaqib/omni

An innovative smart home application that leverages Wi-Fi CSI for presence detection and gesture recognition, and enables uses to automate tasks, control devices, and monitor their home’s environment.

Notifications You must be signed in to change notification settings

towaquimbayo/Omni

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

85 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Visitor Badge

Omni

Omni Thumbnail An innovative smart home application developed during nwHacks2025 in just 24 hours. It unifies major smart home standards and leverages Wi-Fi CSI (Channel State Information) for presence detection and gesture recognition, eliminating the need for intrusive cameras. With Omni, users can seamlessly automate tasks, control devices, and monitor their home’s environment through an intuitive web application, all while prioritizing privacy and convenience.

Important

While the current repository contains the core application, additional hardware will be required to fully experience Omni's full functionality which includes a Wi-Fi CSI module, a Google Coral Edge TPU, and the setup of a live stream server to connect the app to your home environment. We are actively working on improving the project to make it easier for others to test and use in the future as we continue development beyond the hackathon.

Check out the devpost submission here.

Table of Contents

Screenshots

Login Page Rooms Page
Login Page Rooms Page
Devices Page Automations Page
Devices Page Automations Page

Acknowledgements

Contributors

Technologies

  • React.js v18.3.1
  • React Audio Visualize v1.2.0
  • React Helmet v6.1.0
  • Hls.js v1.5.19
  • TailwindCSS v3.4.17
  • TypeScript v5.6.2
  • Vite v6.0.5
  • Python
  • Flask v3.0.3
  • Keras v2.13.1
  • Numpy v1.24.3
  • Pandas v2.0.3
  • PyAudio v0.2.14
  • Scikit-Learn v1.3.2
  • Transformers v4.46.3

Features

Presence and Gesture Recognition

  • Wi-Fi CSI Detection: Utilizes Wi-Fi CSI (Channel State Information) to detect motion, recognize gestures, and identify room-level presence without the need for using intrusive cameras.
  • Privacy-First Design: Eliminates the need for cameras, ensuring greater privacy in sensitive areas like bathrooms or bedrooms.

Home Monitoring

  • Room Statistics Dashboard: Displays real-time data for connected rooms including temperature, humidity, and power consumption.
  • Integrated Thermostat: Control and adjust your room’s temperature directly from the app.
  • Room Live Stream: Set up live camera feeds for enhanced monitoring, enabling you to view specific rooms directly through the app.

Device Management and Automation

  • Device Management: View, connect, and control a list of smart devices including lights, speakers, doors, vacuums, and more with ease, providing full control over your smart home ecosystem.
  • Customizable Automation: Create tailored automations such as turning on entrance lights, starting a coffee machine, and playing music upon detecting your arrival.

Voice Assistant

  • Local Speech Processing: Leveraging a Google Coral Edge TPU, Omni processes voice commands locally for faster, more private interactions.
  • Wake-Word Detection: Includes natural language processing to understand and execute commands, enabling natural interaction with your smart home.

About

An innovative smart home application that leverages Wi-Fi CSI for presence detection and gesture recognition, and enables uses to automate tasks, control devices, and monitor their home’s environment.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Assembly 41.7%
  • CMake 37.5%
  • C 11.4%
  • C++ 5.0%
  • TypeScript 2.9%
  • Python 1.4%
  • Other 0.1%