Process: Organize a reviewer workshop

[hongsupshin]

• Technical and editorial guideline for reviewers
• Add questions, yes/no, types as a guideline.
• Ask the program committee to share the reviewer guideline in the 2025 page: https://www.scipy2022.scipy.org/chair-reviewer-guidelines
• Potential collaboration w/ PREreview

[hongsupshin]

Todo

• Add Ana to the ticket
• Organized a kickoff meeting
• Schedule the date and format

[hongsupshin]

Let's decide the format and date first.

• Date: I think it would make sense to do a workshop after the reviewers are assigned to their papers. Currently "Assignment of reviewers to papers" is set to early June, so we can organize this right after that. This gives us about 3 months.
• Format
  • Option 1. Video conference: As the program committee has been doing, we can organize a zoom session (in two different time slots or we record this) and do a presentation. I'd say maybe 20-30 min presentation with 10-15 min Q&A?
  • Option 2. Written instructions: I think what we have in the 2022 page is good but this is mostly about fairness and general guidance, and we will have to provide something more specific. I think regardless of the zoom meeting, we will have to document this and keep it in our repo so that reviewers have access to it all the time.

@anacomesana @ameyxd Thoughts?

[anacomesana]

I think it makes sense to have a video tutorial after the assignments! That way they can take a look at them and bring up any specific questions they may have.
But it would be good to refer them to written instructions and have them read them before the video tutorial. Perhaps something in checklist format, or prompting questions for each section? We could also refer to the previous criteria.

[ameyxd]

I agree with @anacomesana. In the past we had comprehensive text instructions, and still had some reviewers not follow them. Additionally, a detailed zoom session, especially with content where I highlight what NOT to do (e.g. lazy reviews, etc.) would be the best. That should be about 30-45 mins.