PCI RR (Peer Community In Registered Reports) 
Overall rating of Registered Reports peer review process
Based on 50 ratings from authors/reviewers
Speed: 4.8 (92)Number of question responses this average is based on
Quality: 4.7 (704)Number of question responses this average is based on
View dashboard of all journals
Add your peer review feedback for this journal (needs login/registration)
By stage
| Stage | Speed | Quality |
|---|---|---|
| Stage 1 | 4.8 (76)Number of question responses this average is based on | 4.6 (539)Number of question responses this average is based on |
| Stage 2 | 4.7 (16)Number of question responses this average is based on | 4.9 (165)Number of question responses this average is based on |
By role
| Role | Speed | Quality |
|---|---|---|
| Author | 4.8 (83)Number of question responses this average is based on | 4.7 (507)Number of question responses this average is based on |
| Reviewer | 4.8 (9)Number of question responses this average is based on | 4.6 (197)Number of question responses this average is based on |
By role x Stage
| Role x Stage | Speed | Quality |
|---|---|---|
| Author (Stage 1) | 4.8 (70)Number of question responses this average is based on | 4.6 (385)Number of question responses this average is based on |
| Author (Stage 2) | 4.7 (13)Number of question responses this average is based on | 4.9 (122)Number of question responses this average is based on |
| Reviewer (Stage 1) | 4.8 (6)Number of question responses this average is based on | 4.6 (154)Number of question responses this average is based on |
| Reviewer (Stage 2) | Not enough data ? | 4.8 (43)Number of question responses this average is based on |
By question
This section shows average ratings/distributions for each question in the feedback survey, by role and stage. It may be that you are particularly interested in one aspect of the Registered Reports peer review process at this journal, beyond the ratings above. N.B. Some of these will be more useful than others, but we want to present everything!
| Question | Stage 1 | Stage 2 |
|---|---|---|
| Speed of response to a presubmission enquiry (if applicable) | 5 (18)Number of question responses this average is based on | — |
| Speed of response to any other author enquiries (if applicable) | 4.9 (23)Number of question responses this average is based on | 5 (5)Number of question responses this average is based on |
| Speed of Stage 1 peer review | 4.7 (29)Number of question responses this average is based on | — |
| Speed of Stage 2 peer review | — | 4.5 (8)Number of question responses this average is based on |
| Speed of the editorial decision (when manuscript was rejected) | No data yet ? | No data yet ? |
| Question | Stage 1 | Stage 2 |
|---|---|---|
| Speed of response by the journal to your enquiries (if any) | 4.8 (6)Number of question responses this average is based on | Not enough data ? |
| Question | Stage 1 | Stage 2 |
|---|---|---|
| Administrative handling of the manuscript, over and above the review process | 4.9 (24)Number of question responses this average is based on | 4.8 (8)Number of question responses this average is based on |
| Clarity and accessibility of the journal's RR policy | 4.7 (27)Number of question responses this average is based on | 5 (8)Number of question responses this average is based on |
| Clarity and efficiency of the manuscript handling system | 4.4 (28)Number of question responses this average is based on | 4.6 (8)Number of question responses this average is based on |
| Flexibility of editor to unforeseen circumstances, e.g. in granting extensions of submission deadline, necessary deviations from the approved protocol etc. | 5 (18)Number of question responses this average is based on | 5 (5)Number of question responses this average is based on |
| Quality of editorial input, including clarity of editorial guidance | 4.6 (27)Number of question responses this average is based on | 4.8 (8)Number of question responses this average is based on |
| Quality of feedback from the editor in rejection letter | Not enough data ? | No data yet ? |
| Quality of response from the editor to a presubmission enquiry (if applicable) | 4.7 (21)Number of question responses this average is based on | — |
| Quality of Stage 1 peer reviews | 4.6 (28)Number of question responses this average is based on | — |
| Quality of Stage 2 peer reviews | — | 4.9 (7)Number of question responses this average is based on |
| The extent to which the journal adhered to general principles/spirit of RRs | 5 (22)Number of question responses this average is based on | 5 (8)Number of question responses this average is based on |
| The extent to which the journal adhered to its stated policy on RRs | 5 (20)Number of question responses this average is based on | 5 (8)Number of question responses this average is based on |
How many rounds of peer review were there at Stage 1?
0
1
2
3
4
5
6
7
8
9
10+
Prefer not to answer
Don't know/don't recall
Number of peer reviewers at Stage 1
0
1
2
3
4
5
6
7
8
9
10+
Prefer not to answer
Don't know/don't recall
Do you believe the editor read your Stage 1 manuscript?
Yes and in detail
Yes but only superficially
No
Prefer not to answer
Don't know / don't recall
N/A
Has your experience at PCI RR (Peer Community In Registered Reports) changed your opinion of RRs overall?
Yes, my opinion is now more positive
Yes, my opinion is now more negative
No, my opinion is unchanged
Prefer not to answer
Don't know / don't recall
N/A
In retrospect, do you believe the editor made the correct decision in desk-rejecting your Stage 1 manuscript?
- No data yet ?
In retrospect, do you believe the editor made the correct decision in granting in-principle acceptance to your manuscript?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
In retrospect, do you believe the editor made the correct decision in rejecting your Stage 1 manuscript?
- Not enough data ?
To what extent did the editor's rejection letter provide useful information about the reasons for the rejection?
- Not enough data ?
To what extent did you feel coerced into making invalid or unnecessary changes to the manuscript (i.e. hypotheses, methods, analyses) in order to achieve Stage 1 acceptance? Please consider only invalid or unnecessary changes, not changes you agreed with.
Not at all coerced
Somewhat coerced
Heavily coerced
Prefer not to answer
Don't know / don't recall
N/A
To what extent do you believe that the journal (e.g. through editorial action/inaction or policy) bears at least some responsibility for the withdrawal of your submission following Stage 1 acceptance?
- No data yet ?
To what extent do you feel that the reviewers/editor were granted too much, too little, or the right amount of power to shape your study design at Stage 1?
Too little power
About the right amount of power
Too much power
Prefer not to answer
Don't know / don't recall
N/A
Would you submit a Registered Report to PCI RR (Peer Community In Registered Reports) again?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
Have you ever submitted a regular empirical article (other than a Registered Report) to PCI RR (Peer Community In Registered Reports)?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
- Further responses for 'Yes':
- Please compare your experience submitting a Stage 1 Registered Report to PCI RR (Peer Community In Registered Reports) with your previous experience(s) at PCI RR (Peer Community In Registered Reports) submitting a regular empirical article. If you have previously submitted multiple regular articles to PCI RR (Peer Community In Registered Reports), please compare your Registered Report experience with your overall or "average" experience with regular empirical articles at PCI RR (Peer Community In Registered Reports).
- No data yet ?
How many rounds of peer review were there at Stage 2?
0
1
2
3
4
5
6
7
8
9
10+
Prefer not to answer
Don't know/don't recall
Number of peer reviewers at Stage 2
0
1
2
3
4
5
6
7
8
9
10+
Prefer not to answer
Don't know/don't recall
At Stage 2, to what extent did the reviewers/editor evaluate the manuscript at least in part based on the obtained results, over and above your interpretation of those results?
Not at all
Only as necessary to assess whether any prespecified outcome-neutral tests / positive controls / data quality checks succeeded
To a major extent involving the main outcomes
To a minor extent involving the main outcomes
Prefer not to answer
Don't know / don't recall
N/A
At Stage 2, to what extent did the reviewers/editor reevaluate parts of the Stage 1 manuscript (e.g. study rationale, methods, confirmatory analysis plans) that had already received Stage 1 In-Principle Acceptance?
Not at all
To a minor extent
To a major extent
Prefer not to answer
Don't know / don't recall
N/A
At Stage 2, to what extent do you feel that the reviewers/editor pressured (or required) you to perform extra analyses that you believe were invalid or unnecessary?
Not at all
To a minor extent
To a major extent
Prefer not to answer
Don't know / don't recall
N/A
At Stage 2, to what extent do you feel the reviewers/editor pressured (or required) you to inappropriately alter parts of the manuscript that were previously approved at Stage 1?
Not at all
To a minor extent
To a major extent
Prefer not to answer
Don't know / don't recall
N/A
Do you believe the editor read your Stage 2 manuscript?
Yes and in detail
Yes but only superficially
No
Prefer not to answer
Don't know / don't recall
N/A
Has your experience at PCI RR (Peer Community In Registered Reports) changed your opinion of RRs overall?
- Not enough data ?
In retrospect, do you believe the editor made the correct decision in accepting your Stage 2 manuscript?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
In retrospect, do you believe the editor made the correct decision in desk-rejecting your Stage 2 manuscript?
- No data yet ?
In retrospect, do you believe the editor made the correct decision in rejecting your Stage 2 manuscript?
- No data yet ?
To what extent did the editor's rejection letter provide useful information about the reasons for the rejection?
- No data yet ?
To what extent did you feel coerced into making invalid or unnecessary changes to the manuscript (i.e. hypotheses, methods, analyses) in order to achieve Stage 2 acceptance? Please consider only invalid or unnecessary changes, not changes you agreed with.
Not at all coerced
Somewhat coerced
Heavily coerced
Prefer not to answer
Don't know / don't recall
N/A
To what extent do you feel that the reviewers/editor were overly inflexible about necessary deviations from the approved Stage 1 manuscript at Stage 2?
Not at all
To a minor extent
To a major extent
Prefer not to answer
Don't know / don't recall
N/A
Would you submit a Registered Report to PCI RR (Peer Community In Registered Reports) again?
- Not enough data ?
Have you ever submitted a regular empirical article (other than a Registered Report) to PCI RR (Peer Community In Registered Reports)?
- Not enough data ?
| Question | Stage 1 | Stage 2 |
|---|---|---|
| Clarity and accessibility of the journal's RR policy and expectations of reviewers | 5 (10)Number of question responses this average is based on | Not enough data ? |
| Clarity and efficiency of the manuscript handling system | 5 (10)Number of question responses this average is based on | Not enough data ? |
| Extent to which the authors responded appropriately and constructively to your review(s) through either revision or rebuttal | 4.8 (10)Number of question responses this average is based on | Not enough data ? |
| Extent to which the editor helped authors resolve conflicting recommendations between reviewers | 5 (9)Number of question responses this average is based on | Not enough data ? |
| Extent to which the editor took into account your review in their editorial decision(s) | 5 (10)Number of question responses this average is based on | Not enough data ? |
| Flexibility of journal or editor to unforeseen circumstances, e.g. in granting extensions of review deadlines, etc. | 5 (5)Number of question responses this average is based on | Not enough data ? |
| Overall quality of editing (to the extent observed) | 5 (10)Number of question responses this average is based on | Not enough data ? |
| Quality of comments provided by any other reviewers (to the extent observed) | 5 (10)Number of question responses this average is based on | Not enough data ? |
How many rounds of peer review were there at Stage 1?
0
1
2
3
4
5
6
7
8
9
10+
Prefer not to answer
Don't know/don't recall
Did your experience reviewing this manuscript change your view about potentially submitting a Registered Report to PCI RR (Peer Community In Registered Reports) as an author?
Yes: LESS likely to submit a RR to PCI RR (Peer Community In Registered Reports)
Yes: MORE likely submit a RR to PCI RR (Peer Community In Registered Reports)
No
Prefer not to answer
Don't know / don't recall
N/A
Do you believe the editor made the correct editorial decision?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
Do you believe the editor read the manuscript you reviewed?
Yes and in detail
Yes but only superficially
No
Prefer not to answer
Don't know / don't recall
N/A
Has your experience at PCI RR (Peer Community In Registered Reports) changed your opinion of RRs overall?
Yes, my opinion is now more positive
Yes, my opinion is now more negative
No, my opinion is unchanged
Prefer not to answer
Don't know / don't recall
N/A
To what extent do you feel that you were granted too much, too little, or the right amount of power to shape the authors' proposed study design at Stage 1?
Too little power
About the right amount of power
Too much power
Prefer not to answer
Don't know / don't recall
N/A
Would you review a Registered Report for PCI RR (Peer Community In Registered Reports) again?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
Do you feel you received sufficient credit or other acknowledgment for your review?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
- Further responses for 'Yes':
I did not receive any credit or acknowledgement and I'm ok with that
I received some form of credit or acknowledgement and it was sufficient
I received some form of credit or acknowledgement and it was insufficient
I received some form of credit or acknowledgement but I believe it was unnecessary or unwarranted
Prefer not to answer
Don't know / don't recall
- Further responses for 'No':
- No data yet ?
Have you ever reviewed a regular empirical article (other than a Registered Report) for PCI RR (Peer Community In Registered Reports)?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
- Further responses for 'Yes':
- Please compare your experience reviewing a Stage 1 Registered Report at PCI RR (Peer Community In Registered Reports) with your previous experience(s) at PCI RR (Peer Community In Registered Reports) reviewing a regular empirical article. If you have previously reviewed multiple regular articles for PCI RR (Peer Community In Registered Reports), please compare your Registered Report experience with your overall or "average" experience reviewing regular empirical articles at PCI RR (Peer Community In Registered Reports).
- Not enough data ?
Were there any aspects of your review(s) that you feel the authors (or editor) either ignored or dismissed inappropriately?
Yes and on major issues
Yes but only on minor issues
No
Prefer not to answer
Don't know / don't recall
N/A
- Further responses for 'Yes and on major issues':
- No data yet ?
- Further responses for 'Yes but only on minor issues':
- Not enough data ?
How many rounds of peer review were there at Stage 2?
- Not enough data ?
Did your experience reviewing this manuscript change your view about potentially submitting a Registered Report to PCI RR (Peer Community In Registered Reports) as an author?
- Not enough data ?
Do you believe the editor made the correct editorial decision?
- Not enough data ?
Do you believe the editor read the manuscript you reviewed?
- Not enough data ?
Has your experience at PCI RR (Peer Community In Registered Reports) changed your opinion of RRs overall?
- Not enough data ?
To what extent was the approved Stage 1 manuscript available for comparison with the submitted Stage 2 manuscript?
- Not enough data ?
Would you review a Registered Report for PCI RR (Peer Community In Registered Reports) again?
- Not enough data ?
Do you feel you received sufficient credit or other acknowledgment for your review?
- Not enough data ?
Have you ever reviewed a regular empirical article (other than a Registered Report) for PCI RR (Peer Community In Registered Reports)?
- Not enough data ?
Were there any aspects of your review(s) that you feel the authors (or editor) either ignored or dismissed inappropriately?
- Not enough data ?
Across all journals, on how many RR submissions have you been an author/co-author?
1
2
3
4
5
6
7
8
9
10+
Prefer not to answer
Don't know/don't recall
N/A
To what extent do you feel you could have feasibly revised the manuscript to satisfy the concerns raised? (Stage 1 - Manuscript rejected after one or more rounds of specialist peer review)
- Not enough data ?
What was the primary reason for you withdrawing your Stage 1 manuscript before IPA was given?
- No data yet ?
Are you, or have ever been, a member of staff at PCI RR (Peer Community In Registered Reports)?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
Across all journals, on how many RR submissions have you been an author/co-author?
- Not enough data ?
Are you, or have ever been, a member of staff at PCI RR (Peer Community In Registered Reports)?
- Not enough data ?
Across all journals, how many RR manuscripts have you reviewed?
1
2
3
4
5
6
7
8
9
10+
Prefer not to answer
Don't know/don't recall
N/A
Roughly how long did you spend preparing your review, including time taken to read the manuscript?
Less than an hour
About an hour
Several hours
About a day
Several days
Prefer not to answer
Don't know / don't recall
N/A
What was the decision for the manuscript (if you know it)?
Granted in-principle acceptance (IPA)
Revise
Reject
Prefer not to answer
Don't know / don't recall
N/A
Are you, or have ever been, a member of staff at PCI RR (Peer Community In Registered Reports)?
Yes
No
Prefer not to answer
Don't know / don't recall
N/A
What was your final peer review recommendation for the manuscript?
Grant in-principle acceptance (IPA)
Revise
Reject
Prefer not to answer
Don't know / don't recall
N/A
Across all journals, how many RR manuscripts have you reviewed?
- Not enough data ?
Roughly how long did you spend preparing your review, including time taken to read the manuscript?
- Not enough data ?
What was the decision for the manuscript (if you know it)?
- Not enough data ?
Are you, or have ever been, a member of staff at PCI RR (Peer Community In Registered Reports)?
- Not enough data ?
What was your final peer review recommendation for the manuscript?
- Not enough data ?
Prior to your experience at PCI RR (Peer Community In Registered Reports), what was your opinion of Registered Reports overall?
Positive
Neutral / no opinion
Negative
Prefer not to answer
Don't know / don't recall
N/A
Prior to your experience at PCI RR (Peer Community In Registered Reports), what was your opinion of Registered Reports overall?
Positive
Neutral / no opinion
Negative
Prefer not to answer
Don't know / don't recall
N/A
Prior to your experience at PCI RR (Peer Community In Registered Reports), what was your opinion of Registered Reports overall?
Positive
Neutral / no opinion
Negative
Prefer not to answer
Don't know / don't recall
N/A
Prior to your experience at PCI RR (Peer Community In Registered Reports), what was your opinion of Registered Reports overall?
- Not enough data ?