Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MTurk: Get Multi-HIT Tasks Working #4

Open
gilbo opened this issue Aug 13, 2013 · 0 comments
Open

MTurk: Get Multi-HIT Tasks Working #4

gilbo opened this issue Aug 13, 2013 · 0 comments

Comments

@gilbo
Copy link
Member

gilbo commented Aug 13, 2013

As currently coded, each worker can perform at most one HIT (i.e. chunk of work) per experiment/task. While this is great for running actual experiments where we want to limit workers' exposure to the task, it's not so great if we want to let workers get into a groove building scenes or what have you.

However, the system has the appropriate parameters exposed and models available to allow for issuing multiple HITs per Task.

To accomplish this change, take a look at the 'app/models/mt_task.rb' file. If you look at where the HIT is submitted and then logged in the DB, you should see how to launch multiple HITs instead.

Getting this to work right involves two tricky bits:

  1. You need to test this reasonably thoroughly on the sandbox to make sure it's behaving in the way you think it is. You should also check to make sure that the existing task methods (like complete!) still work correctly with multiple HITs.
  2. In order to totally de-couple the desired number of assignments completed from the max number completed by any given worker, you will need some daemon/cron-job or something that detects when the desired number of assignments have been completed or accepted, and then tells the task to expire.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant