MIDI Visualizer

Gtk application to visualize MIDI file as piano tutorial videos.

A project for the course Multimedium Computing Environment (National Taiwan University, 2018 Spring).

Build Environment

Ubuntu

$ sudo apt install python3-venv python3-pip gstreamer1.0-plugins-bad ffmpeg libffi-dev
$ make start

The Makefile script downloads a soundfont (249 MB) and creates virtualenv environment.

Windows

1. Install Python 3.4
   • Noted that PyGObject for Windows do not support Python 3.5 or above
2. Install PyGObject for Windows
   1. Choose these items in GNOME libraries:
      • Base packages
      • Gst-plugins
      • Gst-plugins-extra
      • Gst-plugins-more
      • Gstreamer
      • GTK+
      • JSON-glib
   2. Choose none in non-GNOME libraries
   3. Choose none in development packages
3. Open the cmd.exe to prepare for installing dependencies

   > python -m pip install --upgrade pip
   > pip install requests pycparser

4. Download wheel packages from Unofficial Windows Binaries for Python Extension Packages
   • cffi‑1.11.5‑cp34‑cp34m‑win_amd64.whl
   • moviepy‑0.2.3.4‑py2.py3‑none‑any.whl
5. Open the cmd.exe again to install dependencies

   > pip install cffi‑1.11.5‑cp34‑cp34m‑win_amd64.whl
   > pip install moviepy‑0.2.3.4‑py2.py3‑none‑any.whl
   > pip install gizeh mido intervaltree

6. Open C:\Python34\Lib\site-packages\cairocffi\__init__.py
   • Change line 41 and save

     - cairo = dlopen(ffi, 'cairo', 'cairo-2')
     + cairo = dlopen(ffi, 'cairo', 'cairo-2', 'cairo-gobject-2')

7. Download soundfont from musical-artifacts.com, save it to soundfont/touhou.sf2
8. Execute python3 src/main.py

Details Explanation

Pipeline for Playing Video

Pipeline for Saving Video

Credits

1. Gtk framework
   • Gtk+: a multi-platform toolkit for creating graphical user interfaces
   • Gstreamer: a library for constructing graphs of media-handling components
2. Dependent packages
   • gizeh: a Python library for vector graphics
   • moviepy: a Python library for video editing
   • mido: a library for working with MIDI messages and ports
   • intervaltree: a mutable, self-balancing interval tree
3. Resources
   • midi/charming-domination.mid from Chris33711
   • midi/at-the-end-of-the-spring.mid from Chris33711
   • soundfont/Touhou.sf2 from Musical Artifacts