v1.0.0

This marks a major release for ParlAI worthy of celebration. Thank you to the team, our numerous external contributors, and all of our users.

Major changes

MTurk is dead, long live Crowdsourcing

As the primary impetus for the release of v1.0.0, we have officially removed parlai.mturk from our repo, fully migrating to the newer, Mephisto-based parlai.crowdsourcing. If you have any questions about upgrading, please make sure to check the new tutorial and feel free to ask questions in our new Discussions forum

New discussions forum

We've enabled GitHub Discussions as a new place for individuals to ask more long-lived questions. We still encourage using issues for bug reports, but many "How do I...?" questions are better for Discussions now.

Distilled models

We have released several distilled BlenderBot models (#3313, #3314), as well as code for distilling your own models. See project page.

DECODE model releases

New project on addressing contradictions in dialogue models (#3324, #3325, #3327, #3334, #3309). See project page for more information.

Backwards incompatible changes

• parlai.mturk has been removed in favor of parlai.crowdsourcing (#3362, #3371)
• The API for add_cmdline_args has changed. Please see the PR for information on upgrading. This enables things like defaults that depend on other values, or arguments that depend on other arguments. (#3328)
• Improvements to world logger arguments (#3380)

New features in core

• New distinct metrics (including intra-distinct and inter-distinct). (#3347)
• 40% Speedups in --model-parallel true generations and training (#3326)
• Updated README, autodoc descriptions, PR templates (#3359, #3342, #3345, #3322))
• [developer] Many more task regression tests (#3240)

New features in crowdsourcing

• General improvements to ACUTE-Eval implementation, docs, and introduction of analysis framework (#3374, #3333, #3344, #3305, #3323)
• Conversion of turn annotations to Mephisto (#3262, #3356)
• Mephisto QA data collection (#3318, #3330)
• Mephisto image-chat task (#3320)
• Documentation improvements (#3319, #3373)
• Fixing flaky tests (#3363, #3372, #3321, #3355)

Smaller bugfixes

• Allow differing arguments for dynamic batching in eval/train (#3382)
• fix: deprecated argument when calling transformers>4.0.0 (#3393)
• Small bugs with crowdsourcing (#3346, #3386, #3387)
• Fix a misparse of -o (#3347)
• Fix bert models in distributed. (#3351)
• Suppress PermissionErrors in windows deletions. (#3340)
• Fix for Interactive Web with TF-IDF models (#3381)
• Fix a small bug in Wizard of Wikipedia task (#3100)
• Fix minor idx not-existing issue in world_logging (#3317)