1. Public Health Research Call 2009 Manual of Review Procedure Assignement and Evaluation Process

2. Italian Public Health Research Call 2009
Inserire dati generali sul bando: quando è stato lanciato, categorie principali dei partecipanti, regole più importanti, fondi disponibili, etc etc.
Soprattutto indicazione sulle tematiche che abbiano una corrispondenza con le aree di referaggio.
Public Health Research Call 2009

3. WORK Flow of the research (http://ricerca.cbim.it)
Research Workflow Management System aimed, is a tool of the Directorate of Research of the Ministry of Health, aimed at managing a National Bio-medical Researches Data Base. It manage research proposals definition, evaluation and communication flow between Ministry of Health and research institute from the beginning of research to the end, where institute produce a final results report.
Public Health Research Call 2009

4. Public Health Research Call 2009
On the following slides there are the INSTRUCTIONS on the use of Work Flow which will permit you to register yourself on the system and act as referee for the Italian “Public health research call 2009”
Public Health Research Call 2009

5. Login
To act as referee within the Public health research call 2009 you need to register yourself into the Workflow of the research.
Please go to:
And go under “Reserved Area”
Click on“Reserved Area”
Public Health Research Call 2009

6. Public Health Research Call 2009
First time access
At the first access, system will ask you to:
Change your password
Fill a registration form with some personal data
Choose proposals to evaluate
Public Health Research Call 2009

7. Login
Insert Username and Password (received on your account) and press “Login”
Forgot password ? Please, press here
Public Health Research Call 2009

8. Change password First step: Change your password
Change password at first login
Public Health Research Call 2009

9. Registration Second step:
fill the registration form in with your personal data.
The address you will put on this section will be used to forward you the payment by bank check for your work as referee. Each evaluation will payed 50 Euros
In this form you can select your area/areas of expertise to act as referee.
Personal data
Area to select
Public Health Research Call 2009

10. Registration
When you select your area/areas of expertise some examples of projects will appear just following. It can help you to be sure it is the research area of your expertise.
Example of the project included in the Area selected
Public Health Research Call 2009

11. Public Health Research Call 2009
Registration
To be sure you will act as referee within all your fields of interest you can change or add new area to your list.
Add new area
Public Health Research Call 2009

12. Registration Change area
Project included in the new Area selected is automatically showed
Public Health Research Call 2009

13. Public Health Research Call 2009
Registration
Delete area
Confirm
Public Health Research Call 2009

14. Public Health Research Call 2009
Registration
Accept
Public Health Research Call 2009

15. Public Health Research Call 2009
List of Proposals
Third step:
When you have confirmed your choice a list of projects will appear. You have the possibility to read the title and select the proposals (type and quantity) you would evaluate, and dowload propopsal’s summary
If you need support please contact our Help Desk in the specific section of this website
List of proposal
Public Health Research Call 2009

16. List of Proposals
This list is automatically generated on the applications classified by the Principal Investigator in the same your expertise area/areas
If you would refuse some application please click on the x button,
To accept check the proposal
Press X to reject project
Public Health Research Call 2009

17. List of Proposals Confirm of the rejection
Public Health Research Call 2009

18. List of Proposals
When the list contains proposals which are not coherent with your field of interest you can ask to change.
System ask you if you want to substitute this proposal with a new one
Public Health Research Call 2009

19. List of Proposals Check proposal you want to evaluate
Public Health Research Call 2009

20. List of Proposals
Only when you have confirmed your choice of a preliminary list you will have access to the details of the project: data on Principal investigator; summary, main contents, etc etc.
Confirm the proposal you have checked
Public Health Research Call 2009

21. List of Proposals Confirm the selected projects?
Public Health Research Call 2009

22. You can go back to the areas (Home page: Registration and Area choice
List of Proposals
At this stage if you want to add more proposals to your list you have to ask to the system and it will show you a new list of project always within the research area indicated from you.
You can go back to the areas (Home page: Registration and Area choice
Do you want to add more projects ?
Public Health Research Call 2009

23. List of Proposals
Back to Registration if you want to change your personal data or change Area choice
Back to the Registration if you want to chang your peroto change areas
Public Health Research Call 2009

24. Review management home page
View the proposal list
Add new proposal to evaluate
Public Health Research Call 2009

25. Review management home page
Personal data
Help Desk
You can download this manual
Public Health Research Call 2009

26. Proposals list to evaluate
Your proposals list to evaluate
Click here to have access to proposal detail
Public Health Research Call 2009

27. Proposal detail Title of project to evaluate Summary of the proposal
Project data
Public Health Research Call 2009

28. Proposal detail Please clik here to go to evaluation page
Public Health Research Call 2009

29. Evaluation page
For each assigned criteria of evaluation you are requested to:
Give a score considering that 1 is maximum and 9 is minimum.
Give a short comment comprehensive of strenght and weakness aspects, if pertinent within the criteria.
Declare you haven’t a conflict of interest
Insert evaluation
Public Health Research Call 2009

30. Public Health Research Call 2009
Conflict of interest
Please refrain from evaluating the proposal in case of past (up to 3 years) or present collaborations or other interactions with the applicants or if you are expecting any benefit in a professional, financial, or personal aspect from the success or failure of this application.
Public Health Research Call 2009

31. Evaluation page
At the end of the evaluation you are requested to give a complexive comment on the proposal
Afterwards you can submit your evaluation to the system.
Input scores
Submit evaluation
Final assesment
Public Health Research Call 2009

32. Evaluation page
If you wish to change or modify any comments you can go back and Update review
If you consider the review completed, you can close and send it
Public Health Research Call 2009

33. After this submission, the evaluation will be unmodifiable
Evaluation page
To send the evaluation you need to insert your password.
After this submission, the evaluation will be unmodifiable
Public Health Research Call 2009

34. How face to face review works 1/2
The “face to face” review function permits to the referees who had evaluated the same proposal to compare their opinion by using a forum, and come to common and unique score.
For the “face to face” the referees have a reserved area for the discussion.
The system considers as manager of the “face to face” the referee who has concluded earlier the evaluation and that become “team leader”.
Following the examination of the other two evaluations the team leader can propose a score.

35. How face to face review works 2/2
Other members can accept the score or discuss their different opinions.
Every team members can submit a comment in the discussion area.
Following each “face to face” discussion a new common score can be adopted.
Face to face review is considered closed when the team of evaluators has agreed a common score

36. Review management home page
Face to face review proposal list
Face to face review
Public Health Research Call 2009

37. Face to face proposal list
Team Leader is the first referee who has submitted his evaluation to the system
In the list, are shown proposal and rank assigned by every referee
When every referee accept the proposed score, it becames FINAL
Public Health Research Call 2009

38. Face to face proposal list
Click here to enter Face to face discussion
Public Health Research Call 2009

39. Face to face disussion: compare evaluation
Here, you can compare evaluation and scores
Public Health Research Call 2009

40. Face to face disussion: application data
Here, you can read application main data
Public Health Research Call 2009

41. Face to face disussion Current proposal is shown here
A system message will be submitted, for each proposal
You are team leader for this proposal. So you can submit a new score here
Public Health Research Call 2009

42. Face to face discussion
You can also add comment by using this space
Public Health Research Call 2009

43. Face to face discussion
Click here if you want to accept the team leader proposal
You are NOT team leader for this proposal, so you can accept the proposed score, and add a comment, but you can’t propose any score
Public Health Research Call 2009

44. Help Desk Click here to create a new request
Public Health Research Call 2009

45. Help Desk Fill up request form
Response will be send to your address
Submit your request
Public Health Research Call 2009