A fork of the Jasper voice computing platform with a focus on:
- Decoupling audio input processing, voice output and conversation handlers
- Removal of features not required for the above to run (wifi setup, sudo, etc.)
- PEP8 via Flake8, code modularization, DRY
- Replacement of magic strings w/ settings
- Portability and documentation for setup in the README
- Tests
We tried really hard to reduce dependencies and make this application installable inside a virtualenv only, but because of the large number of C-bindings and non-pip packages, it ends up being easier (sadly) to install requirements in system wide packages. For developing on a Mac:
Because if you are on a Mac, you should use Homebrew http://brew.sh/.
We'll use portaudio to access the system's soundcard.
brew install portaudio
PyAudio has a convenient installer here http://people.csail.mit.edu/hubert/pyaudio/. However, the installer ignores standard paths and will instead put the PyAudio python lib as well as the C bindings into the system's built-in site-packages folder. On 10.8, this is in /Library/Python/2.7/site-packages. Go ahead and install anyways. We'll use this path later when we set up our virtual environment.
Pocketsphinx is what we'll be using to convert spoken word audio to text. It runs the conversion of speach-to-text offline. We'll be using this feature for detection of our onset phrase (defaults to "ok computer"). Install with brew install cmu-pocketsphinx.
If you want to use a virtualenv for the pip installable packages (recommended), you'll need to reference your Homebrew installed site-packages in the site-packages folder of your virtual environment. Similarly, we'll need to reference the PyAudio installed library and bindings. To do this:
-
Create a virtual environment, and then
-
Create
.pthpath files that references the external site-packages:echo '/usr/local/lib/python2.7/site-packages' > $VIRTUAL_ENV/lib/python2.7/site-packages/homebrew.pth echo '/Library/Python/2.7/site-packages' > $VIRTUAL_ENV/lib/python2.7/site-packages/sys.pth
Finally, you can run pip install -r requirements.txt
Otto is developed by Charles Covey-Brandt and Stephanie Stroud with the help of lots of contributors.
Jasper is developed by Shubhro Saha and Charles Marsh. Both can be reached by email at saha@princeton.edu and crmarsh@princeton.edu respectively.
Jasper has recieved contributions by:
Jasper is released under the MIT license, a permissive free software license that lets you do anything you want with the source code, as long as you provide back attribution and "don't hold [us] liable". Note that this licensing only refers to the Jasper client code (i.e., the code on GitHub) and not to the disk image itself (i.e., the code on SourceForge).
The MIT License (MIT)
Copyright (c) 2014 Charles Marsh & Shubhro Saha
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.