Skip to content
Joshua Shinavier edited this page Oct 9, 2023 · 2 revisions

Semantic Synchrony is a collection of interrelated projects in hardware and software for context-aware computing with semantics. It contains:

  • Extend-o-Brain: a personal knowledge base with a wiki interface and Semantic Web interoperability. It connects to a TinkerPop-compatible graph database and includes an Emacs major mode called Brain-mode (think Org-mode with a graph of notes instead of a hierarchy). See Extend-o-Brain installation.
  • Extend-o-Hand: a Bluetooth-enabled gestural data glove with programming for handshakes, hand-offs (a virtual give-take interaction), and simple gestures including waves and taps. An early version of Extend-o-Hand was used in a keyboard-less typing system.
  • Monomanual Typeatron: a 3D-printed wireless chorded keyer with integrated laser pointer, 6-axis motion sensor, and haptic outputs
  • Omnisensory Monitron: a stationary Arduino-based device which gathers a variety of sensor data and produces a data stream using controlled vocabularies. See Semantics and Sensors
  • SmSn Server: a Gremlin script engine which connects Extend-o-Brain with its Emacs UI, the Brainstem, and any number of context-aware clients with each other through the Stream42 continuous SPARQL query engine and gestural services. More information here.
  • SmSn P2P: a simple framework for service discovery and data streaming using JSON and OSC
  • SmSn RDF: controlled RDF vocabularies and utilities for modeling gestures and other events
  • SmSn Chrome Plugin: a bookmark tool for use with Extend-o-Brain

See also:

  • SmSn Android: contains the Brainstem, which controls and receives data from the Bluetooth devices, and a port of much of the Semantic Synchrony stack to Android/Dalvik
  • SmSn demos a collection of demos, utilities, and scripts for analysis
  • SmSn "extras", which contain lightweight support for RFID tracking and speech recognition, among other things