This survey is part of an exploratory study on guidelines for runtime verification and field-based testing of robotic systems. We build guidelines taking inspiration from both academics and practitioners, looking into scientific papers and both proof-of-concept implementations and established tools from github. The long-term goal is to build better methods and tools for gathering confidence in robotic systems, which requires proper infrastructure. The guidelines aim to assist both developers and QA teams to perform runtime verification (RV) and field-based testing (FT) in the context of ROS. Now, we need to understand whether the guidelines are aligned with best practices by surveying experts in the domain.

Instructions: The questionnaire consists of three parts. 1st. Familiarize yourself with an overview of the guidelines (Link: http://bit.ly/3FE7vXN).
2nd. Provide your opinion on usefulness, clarity, and applicability of the guidelines. We also ask for suggestions to improve methods and tools for runtime verification and field-based testing of ROS-based robotic systems.
3rd. We briefly ask about your experience and background to put your responses into context.
* For a deeper understanding of our stance on field-based testing, check doi: 10.1145/3447240
* For a deeper understanding of our stance on runtime verification, check doi: 10.1007/s10009-021-00609-z

The survey takes approximately 15 minutes to complete. We will keep your responses confidential and only store them for analysis. The report will only contain aggregated summaries of the responses and anonymized quotes.

Please let us know if you have any questions. You can contact directly <ricardo.caldas@chalmers.se>. Thank you in advance for your valuable contribution. Your participation will significantly contribute to advancing the field of testing for robotic systems.

Sincerely,

Ricardo Caldas (Chalmers University of Technology, Sweden)
Juan Antonio Piñera García (Gran Sasso Science Institute, Italy)
Matei Schiopu (Chalmers University of Technology, Sweden)
Genaína Nunes Rodrigues (Universidade de Brasília, Brazil)
Patrizio Pelliccione (Gran Sasso Science Institute, Italy) Thorsten Berger (Ruhr University Bochum, Germany and Chalmers|University of Gothenburg, Sweden)