Average rating for session
Upon receiving sufficient number of reviews, each submission (special session of type Academic or RiA, or individual paper) should have an average rating calculated. Based on the ranking of average ratings submissions will be selected for participation (above cut-off line) or rejected (below cut off line, and those that do not satisfy minimum points on criteria 1 and 2). The average rating can be updated, based on additional reviewes performed by admin or orga.
The average rating is claculated this way: For special sessions: Rating= (Expert1 review rating + Expert2 review rating)/2 If rating by orga or admin is added, it carries same weight as expert review and the total is then divided by 3.
This will be related to issue #73 (closed) and the issue on diveregence of marks: admin and orga will need a table view showing the rating given by each reviewer (either expert or peer), average final rating calculated by formula above, and any special marks like rejection due to failing minimum thershold on critera 1 and 2. It would be good is this table could be exported to a spreadsheet so that further calculations can be performed on it offline, but this last request is not essential.
-
Calculate Average Rating -
Table view showing rating given by each reviewer -
Display average Final Rating -
Special mark failing Minimum Threshold -
Special mark divergent reviews
Optional:
-
CSV Export