Page:EPIC Oxford report.pdf/22

 The key articles in previous literature that informed the design of the tool used in this study were as follows:

3.4.2 Standardisation and Anonymisation Protocol

A standardisation and anonymisation protocol was drawn up to ensure that all cues as to the source of the articles were removed. This included the removal of particular formatting patterns such as the article tree at the beginning of Wikipedia articles, special in-text references and internal links and the names of the article's authors.

Fig. 3.4 summarises the steps in the standardisation and anonymisation process. All standardisation and anonymisation was conducted by three researchers native in English, Spanish and Arabic respectively who were not part of the review panel of the study.

Step 1: Reading of article to identify vandalism

After pasting the article into a MS Word document, standardisers were asked to read through the article to identify any vandalism (this was of particular importance for Wikipedia entries which are open to edition by any user). Vandalism was defined as any addition, removal or change of content in a deliberate attempt to compromise the integrity 22