TOP Factor Quiz

JavaScript isn't enabled in your browser, so this file can't be opened. Enable and reload.

TOP Factor Quiz

Use this quiz to test your familiarity with scoring journal guidelines based on the TOP Guidelines.

Email *

Record my email address with my response

Why is this Replication policy a 1?

"To promote replication of empirical research, AP will consider manuscripts reporting on replications of empirical studies previously published in AP , subject to standard peer review. The title of such submissions should indicate that the study is a replication. Accepted manuscripts will appear online only and will be listed in the print and digital table of contents with e-pagination."

1 point

Journal discourages submission of replication studies, or says nothing.

Journal encourages submission of replication studies and conducts results blind review.

Journal uses Registered Reports as a submission option for replication studies with peer review prior to observing the study outcomes.

Journal encourages submission of replication studies.

Score this Replication policy: "The journal publishes replications only if they represent significant advances in psychological science and/or practice, consistent with the aims and scope of Psychological Bulletin."
*

1 point

Score this Data Transparency policy: "Data and replication code for your article, as well as a log demonstrating smooth running of all the replication files, must be uploaded in a single .zip file to The JOP's Dataverse... All manuscripts are accepted contingent on their replicability, which will initially be assessed by the JOP replication analyst staff who will be assigned to your manuscript at conditional acceptance stage. Manuscripts that are not replicable will be rejected for publication."
*

1 point

Score this Open Science Badges policy: "In recognition of authors' efforts to make their research output more accessible, authors have the option to request that manuscripts are published with up to three badges recognising open scientific practices. The three badges, created by the Open Science Framework (OSF), are: Open Data Open Materials Preregistered"
*

1 point

Score this Registered Reports & Publication Bias policy: "Exceptional Children will review and grant conditional acceptance to plans for studies that are submitted prior to the actual conduct of the research..."
*

1 point

Why is this Study Preregistration policy a 0?

"BMC supports initiatives to improve reporting of clinical trials. This includes prospective registration of clinical trials in suitable publicly available databases. In line with ICMJE guidelines, BMC requires registration of all clinical trials that are reported in manuscripts submitted to its journals."

1 point

Article states whether preregistration of study exists, and, if so, where to access it.

Journal only requires registration of one type of study such as clinical trials or says nothing.

Article states whether preregistration of study exists, and, if so, allows journal access during peer review for verification.

Journal requires preregistration of studies and provides link and badge in article to meeting requirements.

Why is this Data Citation policy a 3?

"All data, code, scripts, syntax, materials, and other methods must be appropriately cited. As such, these materials are recognized as original intellectual contributions and afforded recognition through citation. Articles will not be published until the citations conform to these standards."

1 point

Article is not published until providing appropriate citation for data and materials following journal's author guidelines.

No mention of data citation.

Journal describes citation of data in guidelines to authors with clear rules and examples.

Article provides appropriate citation for data and materials used consistent with journal's author guidelines.

Score this Analysis Code Transparency policy: "For publication, any previously unreported custom computer code or algorithm used to generate results that are central to the main conclusions of a paper must be archived in a publicly accessible repository."
*

1 point

Why is this Open Science Badges policy a 1?

"Note that for regular articles, Collective Intelligence only offers Open Data and Open Materials badges. Preregistration badges are currently for Registered Reports only. Please refer to the more detailed Registered Report guidelines below."

1 point

Journal does not award open science badges.

Journal awards 1 or 2 open science badges.

Journal awards all 3 open science badges

Score this Data Citation policy: "BMC endorses the Force 11 Data Citation Principles and requires that all publicly available datasets be fully referenced in the reference list with an accession number or unique identifier such as a digital object identifier (DOI)."
*

1 point

Why is this Design & Analysis Reporting Guidelines policy a 2?

"CGH requires authors to follow standards for disclosing key aspects of the research design and data analysis. Authors are encouraged to review the standards available for many research applications from http://www.equator-network.org/ and use those that are relevant for the reported research applications. For meta-analyses of randomized, controlled trials, authors must provide a PRISMA checklist at manuscript submission following the PRISMA reporting guidelines found here: http://www.prisma-statement.org/index.htm. For meta-analyses of observational studies, authors must follow the MOOSE reporting guidelines found here: http://www.editorialmanager.com/jognn/account/MOOSE.pdf."

1 point

Journal requires adherence to design transparency standards for review and publication.

Journal encourages design and analysis transparency, or says nothing.

Journal articulates design transparency standards.

Journal requires and enforces adherence to design transparency standards for review and publication.

Find the Replication policy from this journal and score from 0-3.
*

1 point

Find the Registered Reports & Publication Bias policy from this journal and score from 0-3.
*

1 point

Why is this Analysis Code Transparency policy a 1?

"Authors must, in the Acknowledgments section or the first footnote, indicate if they will or will not make their data, analytic methods, and study materials available to other researchers."

1 point

Journal encourages code sharing, or says nothing.

Code must be posted to a trusted repository. Exceptions must be identified at article submission.

Article states whether code is available, and, if so, where to access it.

Code must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication.

Find the Data Transparency policy from this journal and score from 0-3.
*

1 point

Your Name

Score this Analysis Plan Preregistration policy: "Nature Portfolio journals support study pre-registration (including clinical trials) and pre-registration of analysis plans in public repositories; details of pre-registration should be provided with submission."
*

1 point

Score this Materials Transparency policy: "All authors must include an “Availability of Data and Materials” section in their manuscript detailing where the data supporting their findings can be found."
*

1 point

Find the Open Science Badges policy from this journal and score from 0-2.
*

1 point

Why is this Analysis Plan Preregistration policy a 1?

"Articles must state whether or not any work was preregistered and, if so, where to access the preregistration. If any aspect of the study is preregistered, include the registry link in the method section."

1 point

Journal says nothing.

Article states whether preregistration with analysis plan exists, and, if so, allows journal access during peer review for verification.

Article states whether preregistration of study exists, and, if so, where to access it.

Journal requires preregistration of studies with analysis plans and provides link and badge in article to meeting requirements.

Find the Analysis Plan Preregistration policy from this journal and score from 0-3.
*

1 point

Score this Design & Reporting Guidelines policy: "Authors are encouraged to review the standards available for many research applications from the JARS guidelines, the EQUATOR network, the PRISMA guidelines, or similar sources and use those that are relevant for the reported research applications."
*

1 point

Why is this Data Transparency policy a 0?

"This journal encourages and enables you to share data that supports your research publication where appropriate, and enables you to interlink the data with your published articles. Research data refers to the results of observations or experimentation that validate research findings, which may also include software, code, models, algorithms, protocols, methods and other useful materials related to the project."

1 point

Article states whether data are available, and, if so, where to access them.

Journal encourages data sharing, or says nothing.

Data must be posted to a trusted repository. Exceptions must be identified at article submission.

Data must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication.

Find the Study Preregistration policy from this journal and score from 0-3.
*

1 point

Find the Design & Analysis Reporting Guidelines policy from this journal and score from 0-3.
*

1 point

Find the Analysis Code Transparency policy from this journal and score from 0-3.
*

1 point

Find the Materials Transparency policy from this journal and score from 0-3.
*

1 point

Find the Data Citation policy from this journal and score from 0-3.
*

1 point

Why is this Registered Reports & Publication Bias policy a 1?

"In the spirit of sharing findings through our open science mission, emphasis is not placed on novelty, interest, or perceived impact. Replication studies, particularly of research published in this journal, are encouraged."

1 point

Journal states that significance or novelty are not a criteria for publication decisions.

Journal says nothing.

Journal will review studies blinded to results.

Journal accepts Registered Reports for novel studies as a regular submission option.

Why is this Materials Transparency policy a 2?

"Data, program code, research materials, and other documentation of the research process should be made available through a trusted digital repository."

1 point

Journal encourages materials sharing, or says nothing.

Article states whether materials are available, and, if so, where to access them.

Materials must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication.

Materials must be posted to a trusted repository. Exceptions must be identified at article submission.

Score this Study Preregistration policy: "The journal, or an entity acting on behalf of the journal, will verify that preregistration adheres to the specifications for preregistration and then provide certification of the preregistration in the article."
*

1 point

Submit

Clear form

Never submit passwords through Google Forms.

This form was created inside of Center for Open Science. Report Abuse

Forms