Focusing attention to improve the performance of citizen science systems: Beautiful images and perceptive observers

Focusing attention to improve the performance of citizen science systems: Beautiful images and perceptive observers

This SOCS project (NSF 12-11071) examined strategies for dealing with the flood of digital data that confronts researchers. New techniques, tools and strategies for dealing with massive data sets, whether they consist of vast numbers of base-pair sequences or terabytes of data from all-sky astronomical surveys, present an opportunity to establish a 'fourth paradigm' of scientific discovery, but the task is not easy. In many areas of research, the relentless growth of data sets has led to the adoption of increasingly automated and unsupervised methods of classification. In many cases, this has led to degradation in classification quality, with machine learning and computer vision unable to replicate the successes of human pattern recognition. The growth of citizen science on the web has provided a temporary solution to this problem; in particular, the highly successful Galaxy Zoo (Lintott et al. 2008, 2011) and the Zooniverse projects (Smith et al. 2011, Fischer et al. 2011, Davis et al. 2011), which have grown from it and which this proposal takes as its starting point, have demonstrated that it is possible to recruit hundreds of thousands of volunteers to make an authentic contribution to results, boosting human analysis through the collective wisdom of a crowd of classifiers. However, human classifiers alone will not be able to cope with expected flood of data from future scientific instruments. The project was to develop a next-generation socio-computational citizen science platform that combines the efforts of human classifiers with those of computational systems to maximize the efficiency with which human attention can be used. We recognize that to do so requires a thorough understanding of human motivation and learning in this context, and knowledge of how the proposed system will affect these. The project was a partnership between computer and social scientists, addressing research problems both in automated data analysis and social science through systems implementation, alongside field research and experiments with project participants. This project was conducted in collaboration with the Adler Planetarium (Arfon Smith, PI). Carsten Østerlund served as replacement PI at Syracuse University.

Some key publications from the project are listed below.

crowston

Appealing to different motivations in a message to recruit citizen scientists: results of a field experiment

Appealing to different motivations in a message to recruit citizen scientists: results of a field experiment
Attachment Size
JCOM_1701_2018_A02.pdf 306.9 KB
crowston

Building an apparatus: Refractive, reflective and diffractive readings of trace data

Building an apparatus: Refractive, reflective and diffractive readings of trace data
Attachment Size
RA-JAIS-17-0130.R3.1_FIN to share.pdf 892.03 KB
crowston

Characterizing Novelty as a Motivator in Online Citizen Science

Characterizing Novelty as a Motivator in Online Citizen Science crowston

Levels of trace data for social and behavioural science research

Levels of trace data for social and behavioural science research
Attachment Size
160529 levels book chapter.pdf 160.85 KB
crowston

Motivations for sustained participation in crowdsourcing: The role of talk in a citizen science case study

Motivations for sustained participation in crowdsourcing: The role of talk in a citizen science case study crowston

Planet Hunters and Seafloor Explorers: Legitimate Peripheral Participation Through Practice Proxies in Online Citizen Science

Planet Hunters and Seafloor Explorers: Legitimate Peripheral Participation Through Practice Proxies in Online Citizen Science
Attachment Size
paper_revised copy to post.pdf 3.15 MB
crowston

Stages of motivation for contributing user-generated content: A theory and empirical test

Stages of motivation for contributing user-generated content: A theory and empirical test
Attachment Size
crowston fagnot to distribute.pdf 3.76 MB
Anonymous