A gentle introduction to reviewing research papers Alistair Edwards

Writing for the audience Who is the intended readership? conference journal marker peers To what extent are you typical of the intended readers?

Is there a hypothesis? If so Have authors supported or rejected it in their current study? To support the null hypothesis is equally valid scientifically e.g. Animation in web advertising does not improve click-through rates If not Have they nevertheless addressed a valid question?

Is there a story ? If not a bad sign …but is the paper nevertheless readable?

Is there a sufficient literature review? Does it provide sufficient context for the (average) reader?

Is the paper well structured? Introduction Contribution Generally Method Results Discussion Conclusion

Is the quality of the writing good? Can you read it first time? Are grammatical errors non-existent? few? annoying? detracting from your understanding? How readable is it?

Is the voice appropriate? Not too formal – or informal? Is offensive language avoided? Without being too politically correct?

Are figures and tables well used? …and well explained?

Are statements backed by evidence? Are there any opinions?

Is the methodology sound? Validity: construct internal external ecologica l

How good is the abstract? Does it State the contribution made? State the motivation as to why it is interesting? State the methodology followed? State the results? State the conclusions? 1-2 sentences for each of these?

Is there a good introduction? Does it Introduce the topic? ‘This paper is about…’ very early on Introduce the background? Introduce the paper?

Conclusions? Does the paper state – or re-iterate – succinctly: The contribution made? The motivation as to why it is interesting to the audience and how it applies to them? The methodology already described? The key results? What the findings mean to the field and how it is original and important?

What can you say that is positive about the paper? It is easy to be negative The review process tends to encourage this Reasons not to accept papers But positive feedback may be most valuable to the authors

Comments for the committee/editor alone (hidden from the authors) What – if anything – would you put in this section?

Why? Having read the paper, can you answer the questions: Why did the authors write it? Would anyone want to read it?

Your reviews module.cs.york.ac.uk/advt/Tutorials/Review.php