Requester Survey
The purpose of this survey is to identify concerns among researchers in crowdsourcing about the use of technology for answering tasks on crowdsourcing platforms.

Your answers are anonymous and the survey does not store any personal data.
The results of this survey will be used in academic publication. Your submission of this online survey will be taken as your consent for contributing data to this study.

The survey consists of only one page that you can preview below.
Participation will require less than 10 minutes.

The survey is conducted in collaboration with the Crowd Computing Group at the University of Oulu, Finland.
For further questions, you can contact:
Jonas Oppenlaender ( oppenlaenderj@acm.org )
Sign in to Google to save your progress. Learn more
Introduction
In recent years, significant advances have been made in the field of Machine Learning that allow to generate natural-sounding language. BERT and GPT-2/3 are examples of natural language models that can be used to answer questions in a way that is hard to distinguish from human answers. Theoretically, this technology could be used by workers on crowdsourcing platforms to answer tasks.
What do you think about automated answer generation (semi-automatic or fully-automatic with 'bots') on crowdsourcing platforms? *
Please be as broad or narrow as you wish, we are simply interested in anything you might have to say about this topic.
Where do you see the future of crowdsourcing in light of advances in machine learning and the increased availability of tools for natural language generation? *
As a researcher or practitioner in the field of crowdsourcing, how concerned are you about answers being generated on crowdsourcing platforms, such as Amazon Mechanical Turk, today? *
Only few investigations on the use of automated technology (or 'bots') on crowdsourcing platforms can be found in the scientific literature. Why do you think is that? *
You may also enter your own reason(s) in the text box.
Required
In the future, do you think researchers and practitioners in the field of crowdsourcing should be concerned about answers being generated on crowdsourcing platforms, such as Amazon Mechanical Turk? *
Your Expertise with Crowdsourcing
Which crowdsourcing platforms are you familiar with? *
Required
How many years have you been using microtask crowdsourcing platforms, such as Amazon Mechanical Turk, as a requester? *
Please rate your expertise with crowdsourcing *
From your personal experience, please rate the quality of data gathered on crowdsourcing platforms, on a scale from 1 (Very poor) to 5 (Very good). *
How important is data quality to the field of crowdsourcing? *
About You
Do you work in academia or industry? *
What is your primary academic background (e.g. Sociology, Computer Science, Humanities, etc.)? *
What is your age? *
What is your gender identity? *
OPTIONAL: If you want to leave any other comments on the above questions or feedback, you can enter it here.
Submit
Clear form
Never submit passwords through Google Forms.
This content is neither created nor endorsed by Google. Report Abuse - Terms of Service - Privacy Policy
Google Forms