Mining and quality assessment of mashup model patterns with the crowd: A feasibility study

Carlos Rodríguez, Florian Daniel, Fabio Casati

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


Pattern mining, that is, the automated discovery of patterns from data, is a mathematically complex and computationally demanding problem that is generally not manageable by humans. In this article, we focus on small datasets and study whether it is possible to mine patterns with the help of the crowd by means of a set of controlled experiments on a common crowdsourcing platform. We specifically concentrate on mining model patterns from a dataset of real mashup models taken from Yahoo! Pipes and cover the entire pattern mining process, including pattern identification and quality assessment. The results of our experiments show that a sensible design of crowdsourcing tasks indeed may enable the crowd to identify patterns from small datasets (40 models). The results, however, also show that the design of tasks for the assessment of the quality of patterns to decide which patterns to retain for further processing and use is much harder (our experiments fail to elicit assessments from the crowd that are similar to those by an expert). The problem is relevant in general to model-driven development (e.g., UML, business processes, scientific workflows), in that reusable model patterns encode valuable modeling and domain knowledge, such as best practices, organizational conventions, or technical choices, that modelers can benefit from when designing their own models.

Original languageEnglish
Article number17
JournalACM Transactions on Internet Technology
Issue number3
Publication statusPublished - 1 Jun 2016
Externally publishedYes


  • Algorithms
  • Experimentation
  • Human factors

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Mining and quality assessment of mashup model patterns with the crowd: A feasibility study'. Together they form a unique fingerprint.

Cite this