Dialog System Technology Challenges 7 (DSTC 7)

Track 1 - Sentence Selection

This challenge provides a partial conversation, and requires participants to select the correct next utterances from a set of candidates. Unlike previous similar challenges, this task tries to push towards real world problems by introducing:

• A large number of candidates
• Cases where no candidate is correct
• External data

This challenge is offered with two goal oriented dialog datasets, used in 5 tasks. A participant may participate in one, several, or all the subtasks.

If you use this data or code in your work, please cite the task description paper:

@InProceedings{dstc19task1,
  title     = {DSTC7 Task 1: Noetic End-to-End Response Selection},
  author    = {Chulaka Gunasekara, Jonathan K. Kummerfeld, Lazaros Polymenakos, and Walter S. Lasecki},
  year      = {2019},
  booktitle = {7th Edition of the Dialog System Technology Challenges at AAAI 2019},
  url       = {http://workshop.colips.org/dstc7/papers/dstc7_task1_final_report.pdf},
  month     = {January},
}

If you use the Ubuntu data, please also cite the paper in which we describe its creation:

@Article{arxiv18disentangle,
  author    = {Jonathan K. Kummerfeld, Sai R. Gouravajhala, Joseph Peper, Vignesh Athreya, Chulaka Gunasekara, Jatin Ganhotra, Siva Sankalp Patel, Lazaros Polymenakos, and Walter S. Lasecki},
  title     = {Analyzing Assumptions in Conversation Disentanglement Research Through the Lens of a New Dataset and Model},
  journal   = {ArXiv e-prints},
  archivePrefix = {arXiv},
  eprint    = {1810.11118},
  primaryClass = {cs.CL},
  year      = {2018},
  month     = {October},
  url       = {https://arxiv.org/pdf/1810.11118.pdf},
}

For more detail, please visit our website.

Organizers

Lazaros Polymenakos, Chulaka Gunasekara – IBM Research AI
Walter Lasecki, Jonathan K. Kummerfeld – University of Michigan