Mutation Tools Selection Survey

JavaScript isn't enabled in your browser, so this file can't be opened. Enable and reload.

Mutation Tools Selection Survey - Practitioners

This is a questionnaire we developed in a research project we are performing to understand which are the most relevant characteristics of mutation tools that a Practitioner takes into account when she/he has to chose one or more of such tools.

Your answers as Practitioner and expert in the mutation testing field is of utmost importance to us. The questionnaire will not need more than 5 minutes to be filled.

Please, answer the questions according to your needs and daily experience.

For additional information please contact one of the following authors:

Domenico Amalfitano: domenico.amalfitano@unina.it
Anna Rita Fasolino: fasolino@unina.it
Ana Paiva: apaiva@fe.up.pt
Rene Just: rjust@cs.washington.edu

Which type of license do you prefer when a mutation tool should be selected?

Open source

Freeware

Commercial tool

Don't care

Clear selection

Is it important that the mutation tool has been updated recently for being selected?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Is it important that the mutation tool supports the most recent Java version?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Is it important that the tool supports integration with built tools like maven and ant?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Is it important that the mutation tool supports the most recent version of JUnit?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

What mutants generation level do you prefer the tool applies?

Byte Code

Source Code

Don't Care

Clear selection

How do you prefer the mutation tool allows to select the test cases to be executed?

I prefer the tool selects them automatically

I prefer manual selection though a GUI

I prefer to select manually through CUI (Character User interface, i.e., the terminal)

Don't care

Clear selection

How do you prefer the mutation tool allows to select the mutation operators to be applied?

By classes of operators

Operator by operator

Don't care

Clear selection

How do you prefer the mutation tool allows to inspect the applied mutants ?

Over the lines of code

Side-by-side windows (one window showing the original and another one showing the mutated version)

Over lines of code over only live mutants

Don't care

Clear selection

Is it important that a mutation tool produces a kill matrix ?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Is it important that the mutation tool implements run-time reduction techniques ?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

It is important that the mutation tool implements equivalent mutation prevention techniques ?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Which is the user interface that you prefer a mutation tool provides?

CUI (Character User interface)

GUI

Third Party IDE (Eclipse, Netbeans, InelliJ Idea)

Don't care

How important is to have clear and complete documentation support ?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Which are the artifacts that you prefer to submit as input to the tool?

Source code (is the mutation tool to take care to compile it)

Byte Code (it is preferred that the compilation step is not executed by the mutation tool)

Don't care

Clear selection

Is it important that the mutation tool produces mutated source code?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Is it important that the mutation tool produces mutated byte code?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Is it important that the mutation tool produces a detailed summary report?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Is it important that the tool produces a reduced test suite?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

It is important to know which are the mutation operators being applied by the tool?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

Since mutation tools name differently the same mutation operators or classes of mutation operators. Do you think it is important to have a common description of mutation operators to be able to compare different tools easier?

Don't care

Not so important

Important

Very important

It is mandatory

Clear selection

There are other aspects or features that you consider when you have to select a mutation tool?

Submit

Clear form

Never submit passwords through Google Forms.

This content is neither created nor endorsed by Google. Report Abuse - Terms of Service - Privacy Policy

Forms