Tag Archives: Citation Analysis

Bibliometrics and peer review – the Italian view

A very interesting new article has just been published by researchers in Italy, who have analysed data from the first Italian national research evaluation to see whether there is a correlation between bibliometric indicators and peer review.

The questions they posed were:

  1. Are peer review judgements and (article and journal) bibliometric indicators independent variables?
  2. What is the strength of the association?
  3. Is the association between peer judgement and article citation rating significantly stronger than the association between peer judgement and journal citation rating?

They found “a compelling body of evidence that judgements given by domain experts and bibliometric indicators are significantly positively correlated” and in their conclusions, they suggest:

Bibliometrics are not independent of peer review assessment. right triangle, filled The correlation between peer assessment and bibliometric indicators is significant but not perfect. right triangle, filled Peer review should be integrated with bibliometric indicators in national assessment exercises.

Franceschet, M & Constantini, A (2010) “The first Italian research assessment exercise: A bibliometric perspective“, Journal of Informetrics, in press, corrected proof Science Direct [Online].



Leave a comment

Filed under REF, Research Impact

Development of bibliometric indicators for the REF – HEFCE

HEFCE have published  “Analysis of data from the pilot exercise to develop bibliometric indicators for the REF – The effect of using normalised citation scores for particular staff characteristics”

The report analyses the data from the pilot exercise to develop bibliometric indicators for the REF. It analyses the effect of using bibliometrics  (citation scores) in the REF upon  certain types of research staff. For example, early career researchers will be less likely to have many citations. It also looks at age and sex, gender, ethnicity, disability of researchers as well as those who are part-time staff.

The report recommends:

 If citation data are used then the four UK higher education funding bodies will need to ensure that institutions planning to make submissions to the REF are aware of the results of this analysis so that they can take them into account when selecting staff for inclusion. Further, panels will also need to account for the differences found and will require guidance as part of their equality briefing.

Leave a comment

Filed under REF, Research Impact

Making an impact: using Journal Citation Reports and other tools to measure the impact of your research

This session for academic staff and researchers will look at the ways you can monitor the impact your publications are having, especially when considering the REF. We will also look at Researcher ID as a way of raising your own profile, Journal Citation Reports, and Web of Science facilities such as cited reference searching, citation mapping, times cited, citation alerts and amending your author name if necessary.

The session will be held in the Library & Information Centre (Room – PC3) on 15th February 2011 from 12.30pm to 1.30pm.

To book a place, please contact i.glen@swan.ac.uk

Leave a comment

Filed under REF, Research Impact

Making an impact: using Journal Citation Reports

Making an impact: using Journal Citation Reports and other tools to measure the impact of your research

Wed. 21st July 10 – 11, PC Room 3 in the Library

This session will look at the ways you can monitor the impact your publications are having, especially when considering the REF. We will also look at Researcher ID as a way of raising your own profile, Journal citation reports, and Web of Science facilities such as cited reference searching, citation mapping, times cited, citation alerts and amending your author name if necessary. To book a place email s.glen@swansea.ac.uk

There is also a new Library web page with further help and advice: Making an impact: using bibliometric tools to assess your research

Leave a comment

Filed under Research Impact

US to measure research impact

A new federal project aims to provide evidence of return on US investment in science. Julia Lane, Director of the Science of Science and Innovation Programme believes manual reporting is inefficient and puts a burden on academics. The study will use citations and patents to monitor the impact of research in a similar way to that originally proposed for the UK REF.

The full story can be found at Chemistry World from the RSC http://135.196.210.195/chemistryworld/News/2010/June/04061002.asp

Leave a comment

Filed under Research Impact

Making an impact: using Journal Citation Reports and other tools to measure the impact of your research

Making an impact: using Journal Citation Reports and other tools to measure the impact of your research.

 Thursday 10th June, 11 am-12, PC Room 3 in the Library

This session will look at the ways you can monitor the impact your publications are having, especially useful when considering the REF. We will also look at Researcher ID as a way of raising your own profile, Journal citation reports, Web of Science facilities such as cited reference searching , citation mapping, times cited, citation alerts and amending your own author name entry if necessary.

To book a place please e-mail  Michele.Davies@swansea.ac.uk

If you are interested in this topic but unable to make this session your subject librarian would be happy to arrange something for you http://www.swansea.ac.uk/lis/HelpandGuides/SubjectTeams/

Leave a comment

Filed under Research Impact