Modeling, enacting, and integrating custom crowdsourcing processes

Stefano Tranquillini, Florian Daniel, Pavel Kucherbaev, Fabio Casati

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Crowdsourcing (CS) is the outsourcing of a unit of work to a crowd of people via an open call for contributions. Thanks to the availability of online CS platforms, such as Amazon Mechanical Turk or CrowdFlower, the practice has experienced a tremendous growth over the past few years and demonstrated its viability in a variety of fields, such as data collection and analysis or human computation. Yet it is also increasingly struggling with the inherent limitations of these platforms: each platform has its own logic of how to crowdsource work (e.g., marketplace or contest), there is only very little support for structured work (work that requires the coordination of multiple tasks), and it is hard to integrate crowdsourced tasks into stateof-the-art business process management (BPM) or information systems. We attack these three shortcomings by (1) developing a flexible CS platform (we call it Crowd Computer, or CC) that allows one to program custom CS logics for individual and structured tasks, (2) devising a BPMN-based modeling language that allows one to program CC intuitively, (3) equipping the language with a dedicated visual editor, and (4) implementing CC on top of standard BPM technology that can easily be integrated into existing software and processes. We demonstrate the effectiveness of the approach with a case study on the crowd-based mining of mashup model patterns.

Original languageEnglish
Article number7
JournalACM Transactions on the Web
Volume9
Issue number2
DOIs
Publication statusPublished - 1 May 2015
Externally publishedYes

Fingerprint

Outsourcing
Industry
Information systems
Availability
Crowdsourcing
Modeling languages

Keywords

  • BPMN4Crowd
  • Crowd Computer
  • Crowdsourcing
  • Processes
  • Tactics

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Modeling, enacting, and integrating custom crowdsourcing processes. / Tranquillini, Stefano; Daniel, Florian; Kucherbaev, Pavel; Casati, Fabio.

In: ACM Transactions on the Web, Vol. 9, No. 2, 7, 01.05.2015.

Research output: Contribution to journalArticle

Tranquillini, Stefano ; Daniel, Florian ; Kucherbaev, Pavel ; Casati, Fabio. / Modeling, enacting, and integrating custom crowdsourcing processes. In: ACM Transactions on the Web. 2015 ; Vol. 9, No. 2.
@article{837fc740e5174cde81f554d953c89f70,
title = "Modeling, enacting, and integrating custom crowdsourcing processes",
abstract = "Crowdsourcing (CS) is the outsourcing of a unit of work to a crowd of people via an open call for contributions. Thanks to the availability of online CS platforms, such as Amazon Mechanical Turk or CrowdFlower, the practice has experienced a tremendous growth over the past few years and demonstrated its viability in a variety of fields, such as data collection and analysis or human computation. Yet it is also increasingly struggling with the inherent limitations of these platforms: each platform has its own logic of how to crowdsource work (e.g., marketplace or contest), there is only very little support for structured work (work that requires the coordination of multiple tasks), and it is hard to integrate crowdsourced tasks into stateof-the-art business process management (BPM) or information systems. We attack these three shortcomings by (1) developing a flexible CS platform (we call it Crowd Computer, or CC) that allows one to program custom CS logics for individual and structured tasks, (2) devising a BPMN-based modeling language that allows one to program CC intuitively, (3) equipping the language with a dedicated visual editor, and (4) implementing CC on top of standard BPM technology that can easily be integrated into existing software and processes. We demonstrate the effectiveness of the approach with a case study on the crowd-based mining of mashup model patterns.",
keywords = "BPMN4Crowd, Crowd Computer, Crowdsourcing, Processes, Tactics",
author = "Stefano Tranquillini and Florian Daniel and Pavel Kucherbaev and Fabio Casati",
year = "2015",
month = "5",
day = "1",
doi = "10.1145/2746353",
language = "English",
volume = "9",
journal = "ACM Transactions on the Web",
issn = "1559-1131",
publisher = "Association for Computing Machinery (ACM)",
number = "2",

}

TY - JOUR

T1 - Modeling, enacting, and integrating custom crowdsourcing processes

AU - Tranquillini, Stefano

AU - Daniel, Florian

AU - Kucherbaev, Pavel

AU - Casati, Fabio

PY - 2015/5/1

Y1 - 2015/5/1

N2 - Crowdsourcing (CS) is the outsourcing of a unit of work to a crowd of people via an open call for contributions. Thanks to the availability of online CS platforms, such as Amazon Mechanical Turk or CrowdFlower, the practice has experienced a tremendous growth over the past few years and demonstrated its viability in a variety of fields, such as data collection and analysis or human computation. Yet it is also increasingly struggling with the inherent limitations of these platforms: each platform has its own logic of how to crowdsource work (e.g., marketplace or contest), there is only very little support for structured work (work that requires the coordination of multiple tasks), and it is hard to integrate crowdsourced tasks into stateof-the-art business process management (BPM) or information systems. We attack these three shortcomings by (1) developing a flexible CS platform (we call it Crowd Computer, or CC) that allows one to program custom CS logics for individual and structured tasks, (2) devising a BPMN-based modeling language that allows one to program CC intuitively, (3) equipping the language with a dedicated visual editor, and (4) implementing CC on top of standard BPM technology that can easily be integrated into existing software and processes. We demonstrate the effectiveness of the approach with a case study on the crowd-based mining of mashup model patterns.

AB - Crowdsourcing (CS) is the outsourcing of a unit of work to a crowd of people via an open call for contributions. Thanks to the availability of online CS platforms, such as Amazon Mechanical Turk or CrowdFlower, the practice has experienced a tremendous growth over the past few years and demonstrated its viability in a variety of fields, such as data collection and analysis or human computation. Yet it is also increasingly struggling with the inherent limitations of these platforms: each platform has its own logic of how to crowdsource work (e.g., marketplace or contest), there is only very little support for structured work (work that requires the coordination of multiple tasks), and it is hard to integrate crowdsourced tasks into stateof-the-art business process management (BPM) or information systems. We attack these three shortcomings by (1) developing a flexible CS platform (we call it Crowd Computer, or CC) that allows one to program custom CS logics for individual and structured tasks, (2) devising a BPMN-based modeling language that allows one to program CC intuitively, (3) equipping the language with a dedicated visual editor, and (4) implementing CC on top of standard BPM technology that can easily be integrated into existing software and processes. We demonstrate the effectiveness of the approach with a case study on the crowd-based mining of mashup model patterns.

KW - BPMN4Crowd

KW - Crowd Computer

KW - Crowdsourcing

KW - Processes

KW - Tactics

UR - http://www.scopus.com/inward/record.url?scp=84930157557&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930157557&partnerID=8YFLogxK

U2 - 10.1145/2746353

DO - 10.1145/2746353

M3 - Article

AN - SCOPUS:84930157557

VL - 9

JO - ACM Transactions on the Web

JF - ACM Transactions on the Web

SN - 1559-1131

IS - 2

M1 - 7

ER -