The goal was to design an affordable, yet highly sophisticated smart-home and AI interface and control system. The ultimate goal of the project is to create a system much like Jarvis from Marvel’s Iron Man movies, or to achieve a system as close as possible.
Several third party technologies, systems, and hardware were integrated via custom code and reverse engineering to achieve the goal. The system is also modular and focuses on wireless communications to allow for easy location transitioning and expandability.
Some of the systems used are Philips Hue, Sonos, CastleOS, Vera, BlueIris, Microsoft Speech, KeyLemon, Honeywell, Roomie Remote, Xbox Kinect, Xbox One, InAir, D-Link Sensors, Asus WiFi Systems, GPS, Ubuntu Linux, Microsoft Windows, Microsoft Surface, Apple and Android mobile devices, Google Glass, Leap Motion, GE Sensors, Intermedia and many more.
This project is a constant WIP as there are always ways to improve the system or new technologies to explore. Currently, in its production state it receives commands via clock, presence, voice control, gesture control, remote control, and direct control. It can control lights, whole-home audio, climate, media systems, security systems, appliances, and virtual systems. It can interact much like Siri or Cortana to answer questions or provide feedback via the internet. It also creates profiles of recognized users and learns their preferences to provide further automatons, recommendations, and an overall better and more seamless experience.