LabelThem

LabelThem is an online markup tool aimed at building image datasets for computer vision research, and integrated with Yandex.Toloka crowdsourcing system.

With LabelThem you can quickly get a markup, with classes and parameters of objects you are interested in, by providing images, lists of classes and parameters of objects, and, if you don't have the resources to label images by yourself, a short description of which types of objects you are interested in, and money to reward Mechanical Turks for performed markup.

Important Notice

At the moment LabelThem works only with Yandex.Toloka crowdsourcing system in Chromium and Chrome web browsers.

Newest version of LabelThem source files, compatible with Yandex.Toloka crowdsourcing platform are located in develop-toloka branch.

If you are only interested in using the system for getting a markup, you can skip the following text and go to the instructions on how to start working with LabelThem system on Yandex.Toloka.

System Prerequisites

In order to get started, you'll need to install NodeJS runtime, Bower package manager and Grunt's command line interface (CLI) globally. You may need to use sudo (for OSX, *nix, BSD etc) or run your command shell as Administrator (for Windows) to do this.

Building the system / Generating source files for Yandex.Toloka

In order to test the system on the local machine, or to generate source files needed to run the system on Yandex Toloka crowdsourcing platform you need to open a directory, which contains LabelThem system source code in a terminal (command shell on Windows), and execute the following commands:

1. bower update // to download libraries used by the system
2. npm install grunt-contrib-cssmin --save-dev // to install css minification plugin
3. npm install grunt-contrib-concat --save-dev // to install contatenation plugin
4. npm update // to install all the pre-defined dependencies (plugins) by going through the package.json file
5. grunt // to generate source files needed to run the system on Yandex Toloka crowdsourcing platform (to build systems minified and concatenated file)

The source files that are needed to run the system on Yandex Toloka crowdsourcing platform are:

1. /front/main.html
2. /build/app.js
3. /build/css/concat.min.css

Instructions on how to start working with LabelThem system on Yandex.Toloka can be found on the corresponding wiki page.