Home

Welcome to MTurkR - the open-source R Package that provides access to the Amazon Mechanical Turk (MTurk) Requester API.

This wiki is a source of documentation for developers and users who are working with (or contributing to) the MTurkR project.

Quick navigation

• Basic Tutorials
  • Installing MTurkR
    • Troubleshooting
  • Creating HITs
    • Creating Single HITs
    • Bulk HIT Creation
    • HIT Design Considerations
    • Modifying Live HITs
    • Circumventing MTurk Pricing Structure for Large Batches
    • Collecting browser metadata in a HIT
  • Qualifications
    • Using Qualifications as a Soft Worker Block
    • Using Javascript as a Soft Worker Block
    • Creating Qualifications and AnswerKeys
    • Pre-Screening Workers with Qualification Tests
    • Handling Qualification Requests
  • Contacting Workers
  • Using Notifications to Monitor HIT Activity
  • [Automatic scoring with HIT and Assignment Review Policies](Review Policies)
  • [Checking the status of your HITs](HIT Status)
  • Requester statistics and worker statistics
• Common use cases
  • Reversing A Rejected Assignment
  • Paying Workers for Unsubmitted HITs
  • Connecting MTurk to off-site survey tools
  • Randomizing the content of a HIT
  • Dynamically assigning access to HITs
  • Multi-wave studies
• Interactive Wizard Documentation
  • Graphical Wizard
  • Simple Text Based Wizard
• Mimic batch features of Requester UI
• MTurk Requester Ethics
  • How much do your HITs pay per hour?
  • Check your TurkOpticon ratings

Other off-site code examples

• CRAN Documentation
• Examples in an introductory article: "Crowdsourcing with R and the MTurk API" in The Political Methodologist 20(1):2-7.
• Examples from a blog post by Solomon Messing: "Streamline Your Mechanical Turk Workflow with MTurkR
• Tutorial from Kyle Dropp for running multi-wave panels using Qualtrics: "Administering Panels on Amazon Mechanical Turk: A Guide to Within-Subjects Experiments"
• https://github.com/leeper/mturkr-article contains slides and article materials for various MTurkR publications and talks.

Places to get help with MTurk

• The official Amazon Mechanical Turk Blog

• mturk tracker provides statistics about HITs and workers in the MTurk marketplace

• For help from workers, to advertise HITs/recruit workers, or see what MTurk workers are thinking and saying about MTurk visit:

  • TurkerNation (also on Twitter)
  • MTurk Crowd
  • MTurk Forum
  • MTurkWiki Forum
  • The MTurk subreddit or Hits Worth Turking For (also on Twitter)
  • mturkgrind and its associated subreddit
  • Dynamo, an Turker activist group, who have a set of worker-written Guidelines for Academic Requesters

• What are workers talking about? Check out mTurk Lingo, the urban dictionary for MTurk.

• For feedback on you and your HITs from workers, visit TurkOpticon or retrieve your reviews directly in R.

• Post your question on Stack Exchange or the AWS Developer Forum

Comments, feedback, bug reports, and suggestions on MTurkR are welcome via email, on Twitter, and on GitHub