Registered Reports

Community FeedbackImage of stars, showing a four out of five stars rating

Cortex Link icon

Overall rating of Registered Reports peer review process

Info icon Based on 44 ratings from authors/reviewers

Speed: 4.6 (83)Number of question responses this average is based on

Quality: 4.6 (643)Number of question responses this average is based on

Rank icon View dashboard of all journals

Add icon Add your peer review feedback for this journal (needs login/registration)


By stage

Stage Speed Quality
Stage 1 4.5 (46)Number of question responses this average is based on 4.5 (310)Number of question responses this average is based on
Stage 2 4.6 (37)Number of question responses this average is based on 4.5 (333)Number of question responses this average is based on

By role

Role Speed Quality
Author 4.5 (83)Number of question responses this average is based on 4.5 (643)Number of question responses this average is based on
Reviewer No data yet ? No data yet ?

By role x Stage

Role x Stage Speed Quality
Author (Stage 1) 4.5 (46)Number of question responses this average is based on 4.5 (310)Number of question responses this average is based on
Author (Stage 2) 4.6 (37)Number of question responses this average is based on 4.5 (333)Number of question responses this average is based on
Reviewer (Stage 1) No data yet ? No data yet ?
Reviewer (Stage 2) No data yet ? No data yet ?

How are these ratings calculated?

By question

This section shows average ratings/distributions for each question in the feedback survey, by role and stage. It may be that you are particularly interested in one aspect of the Registered Reports peer review process at this journal, beyond the ratings above. N.B. Some of these will be more useful than others, but we want to present everything!

QuestionStage 1Stage 2
Speed of response to a presubmission enquiry (if applicable)4.9 (9)Number of question responses this average is based on
Speed of response to any other author enquiries (if applicable)4.7 (15)Number of question responses this average is based on4.8 (15)Number of question responses this average is based on
Speed of Stage 1 peer review4.3 (22)Number of question responses this average is based on
Speed of Stage 2 peer review4.5 (22)Number of question responses this average is based on
Speed of the editorial decision (when manuscript was rejected)No data yet ?No data yet ?
QuestionStage 1Stage 2
Speed of response by the journal to your enquiries (if any)No data yet ?No data yet ?

QuestionStage 1Stage 2
Administrative handling of the manuscript, over and above the review process4.6 (19)Number of question responses this average is based on4.5 (19)Number of question responses this average is based on
Clarity and accessibility of the journal's RR policy4.7 (21)Number of question responses this average is based on4.8 (20)Number of question responses this average is based on
Clarity and efficiency of the manuscript handling system4.3 (20)Number of question responses this average is based on4.6 (20)Number of question responses this average is based on
Flexibility of editor to unforeseen circumstances, e.g. in granting extensions of submission deadline, necessary deviations from the approved protocol etc.4.9 (18)Number of question responses this average is based on5 (20)Number of question responses this average is based on
Quality of editorial input, including clarity of editorial guidance4.9 (22)Number of question responses this average is based on4.8 (21)Number of question responses this average is based on
Quality of feedback from the editor in rejection letterNo data yet ?No data yet ?
Quality of response from the editor to a presubmission enquiry (if applicable)5 (10)Number of question responses this average is based on
Quality of Stage 1 peer reviews4.6 (22)Number of question responses this average is based on
Quality of Stage 2 peer reviews3.9 (22)Number of question responses this average is based on
The extent to which the journal adhered to general principles/spirit of RRs4.9 (21)Number of question responses this average is based on4.8 (21)Number of question responses this average is based on
The extent to which the journal adhered to its stated policy on RRs5 (22)Number of question responses this average is based on4.9 (22)Number of question responses this average is based on

How many rounds of peer review were there at Stage 1?

0
0%
1
15%
2
65%
3
10%
4
5%
5
0%
6
0%
7
0%
8
0%
9
0%
10+
0%
Prefer not to answer
0%
Don't know/don't recall
5%
 
N=20


Number of peer reviewers at Stage 1

0
0%
1
0%
2
45.45%
3
45.45%
4
9.09%
5
0%
6
0%
7
0%
8
0%
9
0%
10+
0%
Prefer not to answer
0%
Don't know/don't recall
0%
 
N=22


Do you believe the editor read your Stage 1 manuscript?

Yes and in detail
72.73%
Yes but only superficially
18.18%
No
0%
Prefer not to answer
0%
Don't know / don't recall
9.09%
N/A
0%
 
N=22


Has your experience at Cortex changed your opinion of RRs overall?

Yes, my opinion is now more positive
63.64%
Yes, my opinion is now more negative
0%
No, my opinion is unchanged
31.82%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
4.55%
 
N=22


In retrospect, do you believe the editor made the correct decision in desk-rejecting your Stage 1 manuscript?

  • No data yet ?

In retrospect, do you believe the editor made the correct decision in granting in-principle acceptance to your manuscript?

Yes
90.91%
No
0%
Prefer not to answer
4.55%
Don't know / don't recall
4.55%
N/A
0%
 
N=22


In retrospect, do you believe the editor made the correct decision in rejecting your Stage 1 manuscript?

  • No data yet ?

To what extent did the editor's rejection letter provide useful information about the reasons for the rejection?

  • No data yet ?

To what extent did you feel coerced into making invalid or unnecessary changes to the manuscript (i.e. hypotheses, methods, analyses) in order to achieve Stage 1 acceptance? Please consider only invalid or unnecessary changes, not changes you agreed with.

Not at all coerced
72.73%
Somewhat coerced
27.27%
Heavily coerced
0%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
0%
 
N=22


To what extent do you believe that the journal (e.g. through editorial action/inaction or policy) bears at least some responsibility for the withdrawal of your submission following Stage 1 acceptance?

  • No data yet ?

To what extent do you feel that the reviewers/editor were granted too much, too little, or the right amount of power to shape your study design at Stage 1?

Too little power
0%
About the right amount of power
90.91%
Too much power
9.09%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
0%
 
N=22


Would you submit a Registered Report to Cortex again?

Yes
95.45%
No
0%
Prefer not to answer
0%
Don't know / don't recall
4.55%
N/A
0%
 
N=22


Have you ever submitted a regular empirical article (other than a Registered Report) to Cortex?

Yes
45.45%
No
45.45%
Prefer not to answer
0%
Don't know / don't recall
4.55%
N/A
4.55%
 
N=22

  • Further responses for 'Yes':

    • Please compare your experience submitting a Stage 1 Registered Report to Cortex with your previous experience(s) at Cortex submitting a regular empirical article. If you have previously submitted multiple regular articles to Cortex, please compare your Registered Report experience with your overall or "average" experience with regular empirical articles at Cortex.

Registered Report experience much better
20%
Registered Report experience slightly better
40%
Registered Report experience and regular article experience about the same
30%
Registered Report experience slightly worse
0%
Registered Report experience much worse
0%
Prefer not to answer
0%
Don't know / don't recall
10%
 
N=10


How many rounds of peer review were there at Stage 2?

0
0%
1
45%
2
30%
3
15%
4
0%
5
0%
6
0%
7
0%
8
0%
9
0%
10+
0%
Prefer not to answer
0%
Don't know/don't recall
10%
 
N=20


Number of peer reviewers at Stage 2

0
4.55%
1
4.55%
2
50%
3
22.73%
4
0%
5
0%
6
0%
7
0%
8
0%
9
0%
10+
0%
Prefer not to answer
0%
Don't know/don't recall
18.18%
 
N=22


At Stage 2, to what extent did the reviewers/editor evaluate the manuscript at least in part based on the obtained results, over and above your interpretation of those results?

Not at all
27.27%
Only as necessary to assess whether any prespecified outcome-neutral tests / positive controls / data quality checks succeeded
45.45%
To a major extent involving the main outcomes
9.09%
To a minor extent involving the main outcomes
13.64%
Prefer not to answer
0%
Don't know / don't recall
4.55%
N/A
0%
 
N=22


At Stage 2, to what extent did the reviewers/editor reevaluate parts of the Stage 1 manuscript (e.g. study rationale, methods, confirmatory analysis plans) that had already received Stage 1 In-Principle Acceptance?

Not at all
27.27%
To a minor extent
45.45%
To a major extent
13.64%
Prefer not to answer
0%
Don't know / don't recall
13.64%
N/A
0%
 
N=22


At Stage 2, to what extent do you feel that the reviewers/editor pressured (or required) you to perform extra analyses that you believe were invalid or unnecessary?

Not at all
72.73%
To a minor extent
22.73%
To a major extent
0%
Prefer not to answer
0%
Don't know / don't recall
4.55%
N/A
0%
 
N=22


At Stage 2, to what extent do you feel the reviewers/editor pressured (or required) you to inappropriately alter parts of the manuscript that were previously approved at Stage 1?

Not at all
68.18%
To a minor extent
27.27%
To a major extent
4.55%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
0%
 
N=22


Do you believe the editor read your Stage 2 manuscript?

Yes and in detail
63.64%
Yes but only superficially
22.73%
No
0%
Prefer not to answer
0%
Don't know / don't recall
13.64%
N/A
0%
 
N=22


Has your experience at Cortex changed your opinion of RRs overall?

  • Not enough data ?

In retrospect, do you believe the editor made the correct decision in accepting your Stage 2 manuscript?

Yes
90.91%
No
0%
Prefer not to answer
4.55%
Don't know / don't recall
4.55%
N/A
0%
 
N=22


In retrospect, do you believe the editor made the correct decision in desk-rejecting your Stage 2 manuscript?

  • No data yet ?

In retrospect, do you believe the editor made the correct decision in rejecting your Stage 2 manuscript?

  • No data yet ?

To what extent did the editor's rejection letter provide useful information about the reasons for the rejection?

  • No data yet ?

To what extent did you feel coerced into making invalid or unnecessary changes to the manuscript (i.e. hypotheses, methods, analyses) in order to achieve Stage 2 acceptance? Please consider only invalid or unnecessary changes, not changes you agreed with.

Not at all coerced
86.36%
Somewhat coerced
13.64%
Heavily coerced
0%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
0%
 
N=22


To what extent do you feel that the reviewers/editor were overly inflexible about necessary deviations from the approved Stage 1 manuscript at Stage 2?

Not at all
86.36%
To a minor extent
9.09%
To a major extent
0%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
4.55%
 
N=22


Would you submit a Registered Report to Cortex again?

  • Not enough data ?

Have you ever submitted a regular empirical article (other than a Registered Report) to Cortex?

  • Not enough data ?
QuestionStage 1Stage 2
Clarity and accessibility of the journal's RR policy and expectations of reviewersNo data yet ?No data yet ?
Clarity and efficiency of the manuscript handling systemNo data yet ?No data yet ?
Extent to which the authors responded appropriately and constructively to your review(s) through either revision or rebuttalNo data yet ?No data yet ?
Extent to which the editor helped authors resolve conflicting recommendations between reviewersNo data yet ?No data yet ?
Extent to which the editor took into account your review in their editorial decision(s)No data yet ?No data yet ?
Flexibility of journal or editor to unforeseen circumstances, e.g. in granting extensions of review deadlines, etc.No data yet ?No data yet ?
Overall quality of editing (to the extent observed)No data yet ?No data yet ?
Quality of comments provided by any other reviewers (to the extent observed)No data yet ?No data yet ?

How many rounds of peer review were there at Stage 1?

  • No data yet ?

Did your experience reviewing this manuscript change your view about potentially submitting a Registered Report to Cortex as an author?

  • No data yet ?

Do you believe the editor made the correct editorial decision?

  • No data yet ?

Do you believe the editor read the manuscript you reviewed?

  • No data yet ?

Has your experience at Cortex changed your opinion of RRs overall?

  • No data yet ?

To what extent do you feel that you were granted too much, too little, or the right amount of power to shape the authors' proposed study design at Stage 1?

  • No data yet ?

Would you review a Registered Report for Cortex again?

  • No data yet ?

Do you feel you received sufficient credit or other acknowledgment for your review?

  • No data yet ?

Have you ever reviewed a regular empirical article (other than a Registered Report) for Cortex?

  • No data yet ?

Were there any aspects of your review(s) that you feel the authors (or editor) either ignored or dismissed inappropriately?

  • No data yet ?

How many rounds of peer review were there at Stage 2?

  • No data yet ?

Did your experience reviewing this manuscript change your view about potentially submitting a Registered Report to Cortex as an author?

  • No data yet ?

Do you believe the editor made the correct editorial decision?

  • No data yet ?

Do you believe the editor read the manuscript you reviewed?

  • No data yet ?

Has your experience at Cortex changed your opinion of RRs overall?

  • No data yet ?

To what extent was the approved Stage 1 manuscript available for comparison with the submitted Stage 2 manuscript?

  • No data yet ?

Would you review a Registered Report for Cortex again?

  • No data yet ?

Do you feel you received sufficient credit or other acknowledgment for your review?

  • No data yet ?

Have you ever reviewed a regular empirical article (other than a Registered Report) for Cortex?

  • No data yet ?

Were there any aspects of your review(s) that you feel the authors (or editor) either ignored or dismissed inappropriately?

  • No data yet ?


Across all journals, on how many RR submissions have you been an author/co-author?

1
59.09%
2
22.73%
3
4.55%
4
4.55%
5
4.55%
6
0%
7
0%
8
4.55%
9
0%
10+
0%
Prefer not to answer
0%
Don't know/don't recall
0%
N/A
0%
 
N=22


To what extent do you feel you could have feasibly revised the manuscript to satisfy the concerns raised? (Stage 1 - Manuscript rejected after one or more rounds of specialist peer review)

  • No data yet ?

What was the primary reason for you withdrawing your Stage 1 manuscript before IPA was given?

  • No data yet ?

Are you, or have ever been, a member of staff at Cortex?

Yes
0%
No
100%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
0%
 
N=22


Across all journals, on how many RR submissions have you been an author/co-author?

  • Not enough data ?

Are you, or have ever been, a member of staff at Cortex?

  • Not enough data ?

Across all journals, how many RR manuscripts have you reviewed?

  • No data yet ?

Roughly how long did you spend preparing your review, including time taken to read the manuscript?

  • No data yet ?

What was the decision for the manuscript (if you know it)?

  • No data yet ?

Are you, or have ever been, a member of staff at Cortex?

  • No data yet ?

What was your final peer review recommendation for the manuscript?

  • No data yet ?

Across all journals, how many RR manuscripts have you reviewed?

  • No data yet ?

Roughly how long did you spend preparing your review, including time taken to read the manuscript?

  • No data yet ?

What was the decision for the manuscript (if you know it)?

  • No data yet ?

Are you, or have ever been, a member of staff at Cortex?

  • No data yet ?

What was your final peer review recommendation for the manuscript?

  • No data yet ?


Prior to your experience at Cortex, what was your opinion of Registered Reports overall?

Positive
90.91%
Neutral / no opinion
9.09%
Negative
0%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
0%
 
N=22


Prior to your experience at Cortex, what was your opinion of Registered Reports overall?

Positive
86.36%
Neutral / no opinion
13.64%
Negative
0%
Prefer not to answer
0%
Don't know / don't recall
0%
N/A
0%
 
N=22


Prior to your experience at Cortex, what was your opinion of Registered Reports overall?

  • No data yet ?

Prior to your experience at Cortex, what was your opinion of Registered Reports overall?

  • No data yet ?