Dynamic word recommendation to obtain diverse crowdsourced paraphrases of user utterances

Mohammad Ali Yaghoub-Zadeh-Fard, Boualem Benatallah, Fabio Casati, Moshe Chai Barukh, Shayan Zamanirad

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Building task-oriented bots requires mapping a user utterance to an intent with its associated entities to serve the request. Doing so is not easy since it requires large quantities of high-quality and diverse training data to learn how to map all possible variations of utterances with the same intent. Crowdsourcing may be an effective, inexpensive, and scalable technique for collecting such large datasets. However, the diversity of the results suffers from the priming effect (i.e. workers are more likely to use the words in the sentence we are asking to paraphrase). In this paper, we leverage priming as an opportunity rather than a threat: we dynamically generate word suggestions to motivate crowd workers towards producing diverse utterances. The key challenge is to make suggestions that can improve diversity without resulting in semantically invalid paraphrases. To achieve this, we propose a probabilistic model that generates continuously improved versions of word suggestions that balance diversity and semantic relevance. Our experiments show that the proposed approach improves the diversity of crowdsourced paraphrases.

Original languageEnglish
Title of host publicationProceedings of the 25th International Conference on Intelligent User Interfaces, IUI 2020
PublisherAssociation for Computing Machinery
Pages55-66
Number of pages12
ISBN (Electronic)9781450371186
DOIs
Publication statusPublished - 17 Mar 2020
Externally publishedYes
Event25th ACM International Conference on Intelligent User Interfaces, IUI 2020 - Cagliari, Italy
Duration: 17 Mar 202020 Mar 2020

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI

Conference

Conference25th ACM International Conference on Intelligent User Interfaces, IUI 2020
CountryItaly
CityCagliari
Period17.3.2020.3.20

Keywords

  • bots
  • crowdsourcing
  • paraphrasing

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Dynamic word recommendation to obtain diverse crowdsourced paraphrases of user utterances'. Together they form a unique fingerprint.

  • Cite this

    Yaghoub-Zadeh-Fard, M. A., Benatallah, B., Casati, F., Barukh, M. C., & Zamanirad, S. (2020). Dynamic word recommendation to obtain diverse crowdsourced paraphrases of user utterances. In Proceedings of the 25th International Conference on Intelligent User Interfaces, IUI 2020 (pp. 55-66). (International Conference on Intelligent User Interfaces, Proceedings IUI). Association for Computing Machinery. https://doi.org/10.1145/3377325.3377486