Full proposal assessment, guidance for experts

Thank you for your commitment to participate in the assessment of the full proposals submitted to this call. We trust that you will find this work both interesting and rewarding. 

The deadline for submitting your assessments is January  13, 2025.

Proposals will be accessible from 10 December 2024 via the NordForsk application portal and the restricted Teams folder. 

Emails from no-reply@nordforsk.org will notify you of the proposals assigned to you. Please log in to the NordForsk application portal and ensure you have access to applications and the assessment form.

Some of the assigned proposals may not be fully aligned with your area of expertise. Nonetheless, we ask you to provide your opinion as general expert in the research area and/or as an informed professional.

Before you start

Throughout the assessment process, expert must adhere to NordForsk’s guidelines on impartiality and principles for assessment.

All application materials are confidential and must not be disclosed. Experts must not seek contact with applicants during the review process. Confidentiality must be maintained even after the review process has been concluded.

After the review process has been concluded, names of the experts involved in both assessment stages will be published. However, individual grading and written explanations made before the panel meeting, will not be shared with applicants. The panel’s collective written explanation of the overall grade, will be made available to the applicants.

Generative AI tools must not be used to assess applications, nor should factual contents or the applicants’ personal data be disseminated. Any other use of AI tools must align with ethical, responsible, and legal standards and requirements. Experts are encouraged to consult the European Commission’s Living guidelines on the responsible use of generative AI in research.

Assessor responsibilities

Each proposal will be evaluated by a minimum of three scientific experts: one principal assessor, and two assessors. The remaining experts in the panel will act as readers. In addition to the experts participating in the panel, some proposals require specific additional expertise and will also be assessed by individual assessors.

  • Principle assessor
    Reads the proposal material in depth, provides justifications for each grade and proposes an overall grade with a brief rationale. This person is responsible for editing, finalising and submitting the panel’s written statement on the overall grade within two days after the panel meeting. If the proposal has been assessed by an individual assessor, the principal assessor is responsible for presenting the grading and statement from the individual assessor to the panel.
  • Assessor
    Reads the proposal material in depth, provides justifications for each grade, and proposes an overall grade with a brief rationale. Contribute to discussions of the proposal’s strengths and weaknesses and assists in drafting the panel’s written statement. They shall give input to the panels written statement.
  • Reader
    Familiarises themselves with the 10-page project plan and participates in discussions, focusing on the proposal’s strengths and weaknesses if necessary.
  • Individual experts
    In addition to the experts participating in the panel, some proposals require specific additional expertise. Individual assessors will read the proposal material in depth, provide justifications for each grade and proposes an overall grade with a brief rationale.

Overview of assessment process

NordForsk applies a scale of grades from one to seven.

Grade
7Outstanding: Exceptionally strong application with negligible weaknesses. The proposal makes an outstanding contribution to the aims of the initiative.
6Excellent: Very strong application with negligible weaknesses. The proposal makes an excellent contribution to the aims of the initiative.
5Very good: Very good application with mi nor weaknesses. The proposal makes a significant contribution to the aims of the initiative.
4Good: Good applications with some weaknesses. The proposal makes a good contribution to the aims of the initiative.
3Fair: Some strengths, but also moderate weaknesses. The proposal makes some contribution to the aims of the initiative.
2Weak: A few strengths, but with at least one major weakness or several mi nor weaknesses. The pro posa I makes limited contribution to the aims of the initiative.
1Poor: Very few strengths, several major weaknesses. The proposal makes little or no contribution to the aims of the initiative.

For each criterion, experts must provide a grade and a short explanation of their assessment. Explanations are for internal use only and should be concise, addressing the key strengths and weaknesses. Referring to the call text is encouraged.

In the assessment form there is a pulldown menu for the grade and a text box for each criterion.

The output from the panel meeting is consensus on overall grade and the panel's written statement.

The eight criteria

Each criterion includes guiding questions to help assess the proposal and assign a grade.

We suggest beginning with criterion 2. Research quality, and then 3. Interdisciplinarity of the research, both of which are described in the Research plan (PDF file).

Continue with Arctic added value and Indigenous perspectives. Relevant guiding text for these criteria, as well as SDG goals, can be found in the application form under “Research-project” in the left side menu.

Please note that special provisions apply to the Indigenous perspectives criterion, see explanation and flow-chart below.

We recommend that you assess the criteria 1. Contributions to call aims last. By then, you will have a comprehensive overview of the proposal.

The assessment portal auto-saves your input (only with a stable internet connection). Clicking on “continue workflow” at the top of the review form, will submit your assessment.

1. Contribution to call aims


To what extent is the proposed research appropriate to the aims and objectives of the call?

To what degree does the proposed research support relevant Sustainable Development Goals (SDGs)?

The call text states:
The aim of the call is to support research collaboration among participating countries in the Arctic region to bring forward new knowledge on how to ensure sustainable development of the Arctic. The objective of the call is to jointly fund interdisciplinary research projects of highest international quality, with potential for impact and societal relevance, and with clear added value from multilateral collaboration. The call has no thematic priorities, but three keywords can inspire the applicants when developing their research ideas into proposals: Security, Natural Resources and/or Societal Changes."

2. Research quality

To what degree is the research idea original and bold?

What is the potential to develop new knowledge beyond current state-of-the-art?

Are the objectives and research questions/hypothesis clear?

Is the concept and methodology sound and credible?

To what degree are the ethical considerations appropriate and how well these will be handled?

Is the consideration and integration of gender perspectives appropriate, when relevant?

Are the described expected research results and expected outcomes of the research credible?

3. Interdisciplinarity of the research

The soundness of the interdisciplinary approach in terms of participation and integration of different disciplines to achieve common goals of the project.

Is the interdisciplinary approach sound in terms of participation and integration of different disciplines to achieve common goals of the project?

Is the described added value to both or all scientific domains, as well as to the interdisciplinary space, appropriate and credible?

The call text states:
"Only truly interdisciplinary research will be funded. Much of the knowledge needs related to the Arctic demand research that dares to think across traditional boundaries between fields and disciplines and strives to create fertile ground for new approaches and insights. This call is for projects combining and integrating skills from multiple disciplines to contribute with new and groundbreaking knowledge for a Sustainable Development of the Arctic. The integration of methods, data, perspectives, concepts, and/or theories from different scientific fields is crucial in the efforts towards expanding the scope of collective knowledge. The call is open to research proposals that combine at least two of the three areas of science as defined by the European Research Council (ERC): Life sciences, Physical sciences and engineering, and Social sciences and humanities. The interdisciplinary approach of the proposals will be assessed, as well as the boldness and originality of the research ideas. More details regarding ERC’s distribution of research areas into the three overarching categories of science can be found here: ERC_panel_structure_2024_calls.pdf (europa.eu)

4. Arctic Added value

Does the project have the potential to create impact on Arctic research through the research collaboration (e.g. by achieving necessary critical mass, enhancing cost-effectiveness by sharing data and research infrastructure, mobility, competence building, enhancing scientific excellence, promoting new innovations and patents, building on unique strengths of the Arctic Region, phenomena, or data)?

Does the project have the potential to create impact for the Arctic societies (e.g. by providing a useful knowledge base for citizens, policymakers, practitioners, and other actors to create societal impact, addressing needs that are unique to the Nordic and Arctic countries)?

The call text states:
“Projects funded by this call should have potential to create substantial added value for the countries involved and for the Arctic region. The call addresses needs that are unique to the Arctic and of particular interest for the countries in the region.
The research projects should create outcomes and impact of greater value for the Arctic than what could be achieved through national activities alone. Research collaboration is an important aspect of collaboration between countries in the Arctic region and can help build critical mass by new combinations of expertise and experience from research communities. Applicants should elaborate on how the proposed project will contribute to Arctic added value by strengthening the Arctic region, enhancing scientific excellence of Arctic research and/or addressing needs or problems that are of special relevance to the Arctic. Arctic added value can also be about building on unique phenomena (e.g., geographical, climactic, cultural, linguistic, or social), data or collections”.

5. Indigenous perspectives

To what extent is the description of relevance of Indigenous perspectives in the proposed research project clear and plausible?

If Indigenous perspectives are considered relevant, to what extent is the incorporation of Indigenous perspectives in the research project inclusive, credible, appropriate, respectful, and ethical?

The call text states: “When considered relevant, the Indigenous perspectives should be an integrated part of the proposed research. A statement of to what extent it is relevant to consider Indigenous perspectives in the project, and in that event, how this will be incorporated in the project, will be evaluated as part of the proposal assessment. Proposers preparing projects working near, with, or impacting, local and Indigenous communities are strongly recommended to engage communities early in the proposal development stages. Proposals that address research areas where the Indigenous perspective does not apply are equally welcome and not precluded from funding.”

If the expert agrees with the applicant’s explanation to why Indigenous perspective do not apply, the pre-proposal should not be graded on the criterion “Indigenous perspectives”. Proposed flow-chart below.

6. Quality of the research team

To what extent does the research consortia include the necessary experience, expertise and merits in relation to delivering the proposed research and how is the complementarity of the research consortium as a whole?

7. Feasibility

How is the quality and effectiveness of the work plan, including extent to which financial and personnel resources are appropriately assigned in line with the objectives and deliverables?

Are the management structures and procedures, including risk management, appropriate?

8. Communication and dissemination

Are the plans for stakeholder involvement appropriate?

How is the quality of the plans for dissemination, knowledge exchange and communication, including the extent to which such activities align with project objectives?

9. Overall grade

Based on the above criteria and justifications, what overall grad of the proposal do you suggest. If you weigh criteria differently, please explain your rationale.

This flowchart shows how to assess the criterion "Indigenous perspective."

Panel meeting

The panel meeting aims to discuss the strengths and weaknesses of each proposals and based the discussion, finalise the panels overall grade, supported by a collective written statement summarising strengths and weaknesses. The panel meeting will be chaired by NordForsk.

The expert panel will convene in a one-day digital meeting on January 23 or January 24 2025. Preparatory material will be accessible one week prior to the meeting.

In preparation of the evaluation task and panel meeting, information meetings are organized on 12 December or 16 December, both from 15.00 – 16.00 CET. Please participate in one of them.

Remuneration

Remuneration will be provided during March 2025. NOK 2000 per proposal as a Principal Assessor, NOK 1600 per proposal as an Assessor, NOK 800 per proposal as a Reader, and NOK 5000 for the one-day digital panel meeting. If you haven’t already sent us your bank information, please fill in the Honorarium form (link under) and email to kristin.andersen@nordforsk.org. Please provide the exact name on the bank account.

Call text: Sustainable Development of the Arctic – Full proposals (invited applicants only) - Insights

Nordforsk Application Portal

NordForsk follows principles for assessment

NordForsk Guidelines of impartiality

Team folder for experts

Honorarium form NordForsk

Support

Contact
Kristin Andersen
kristin.andersen@nordforsk.org
+4790581647

Thorbjørn Gilberg
thorbjorn.gilberg@nordforsk.org
+4741508482

Technical support
support@nordforsk.org

For technical issues relating to portal and submission.