Database of Precedents
-
2.4 Peer-review experts – ANECA – Partial compliance (2023) students, panel members
ANECA
Application Renewal Review Targeted, coordinated by ENQA Decision of 03/03/2023 Standard 2.4 Peer-review experts Keywords students, panel members Panel conclusion Compliance Clarification request(s) Panel (17/02/2023)
RC decision Partial compliance “10. The panel noted that the internal system of the agency generally aimed to have students in every expert panel, in each of ANECA’s procedure. The panel, however, found out that the majority of AUDIT INTERNATIONAL experts panels did not include students (see clarification of 2023-02-17).
11. According to the panel, ANECA found it challenging to ensure student participation in these experts panel due to the limited availability of the students. The Committee acknowledged that recruiting student experts might be more difficult for some reviews than for others, but underlined that this challenge has to be addressed by any agency and cannot serve as a reason to carry out reviews without student panel members.
12. Given the absence of students from most expert panels for AUDIT INTERNATIONAL, the Register Committee was unable to concur with the panel’s conclusion, but concluded that ANECA only partially complies with ESG 2.4.”
Full decision: see agency register entry
-
2.4 Peer-review experts – NEAA – Partial compliance (2023) training, training of experts
NEAA
Application Renewal Review Full, coordinated by ENQA Decision of 13/10/2023 Standard 2.4 Peer-review experts Keywords training, training of experts Panel conclusion Compliance Clarification request(s) – RC decision Partial compliance “8. The Register Committee noted from the panel’s analysis that the trainings of experts have been reduced to only a briefing session taking place before the site visit. The panel’s analysis further show that the last training organised by NEAA took place in 2018 (before the Covid-19 pandemic).
9. The Register Committee underlined that the agency is expected to ensure that experts have the appropriate skills and competences to carry out external reviews and that such skills and competences are acquired through regular (periodic) trainings organised by the agency.
10. In its representation, NEAA provided information that it has started intensively working on preparation and implementation of several trainings focused on specific standards and criteria. NEAA also informed that future training sessions will be included in its Action Plan.
11. The Register Committee welcomed the steps taken by NEAA to address the earlier concerns, but noted that the Committee could not verify whether these training activities will ensure that all members of a panel will be systematically trained prior to undertaking an external quality assurance procedure. The Committee noted that these will remain to be determined in NEAA’s next external review.
12. The Register Committee therefore remained unable to concur with the panel’s conclusion, but considered that NEAA complies only partially with ESG 2.4.”
Full decision: see agency register entry
-
2.4 Peer-review experts – QAA – Compliance (2023) Involvement of students in review panels
QAA
Application Renewal Review Full, coordinated by ENQA Decision of 13/10/2023 Standard 2.4 Peer-review experts Keywords Involvement of students in review panels Panel conclusion Compliance Clarification request(s) – RC decision Compliance “11. The Register Committee already noted in its change report decision (of 2022-10-28) that QAA has changed its policy since the last review and addressed the concerns raised as regards to student involvement in review panels.
12. The Committee was reassured by the panel’s analysis that showed that QAA ensures there is always a student included in its panels for all of the activities under review, except for follow-up visits. The Register Committee understands that follow-up visits are part of an external QA activity, and not a separate activity on its own and therefore finds this approach acceptable.
13. The Register Committee therefore finds the earlier issues addressed and concur with the panel’s recommendation that QAA should extend its pool of international reviewers in light of its own increasing rate of international reviews.”
Full decision: see agency register entry
-
2.4 Peer-review experts – AIC – Partial compliance (2023) student in panel
AIC
Application Renewal Review Full, coordinated by ENQA Decision of 12/12/2023 Standard 2.4 Peer-review experts Keywords student in panel Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “17. The Register Committee stressed in its Substantive Change Report Decision of 2021-10-22 that the group of experts in the inclusion of licenced study programme on the accreditation of study field procedure, does not include a student. While the Committee understands that this procedure was created as a temporary and short-term solution in order to close possible gaps in the accreditation periods of programmes (until the next re-accreditation of the corresponding study field), the Committee could not follow the agency’s decision of not involving students, as per the requirement of the standard 2.4.
18. The Register Committee further noted from the review panel’s report that the agency has not resolved this issue and sustained its position that two experts should be sufficient in this procedure.
19. Considering AIC’s statement to the report that, the Register Committee understood that AIC is applying the national framework. The Committee however underlined that it is AIC’s responsibility to ensure ESG compliance with all standards and that it has taken measures to ensure the involvement of students in all procedures.
20. The Register Committee underlines the panel’s recommendation to include student-members in all procedures involving external experts, in particular in the procedures for Inclusion of a licensed study programme in the accreditation form of study field.
21. In its additional representation, AIC explained that the inclusion of licenced study programme on the accreditation of study field procedure is not a stand-alone procedure, but a temporary measure while the new quality assurance system from 2025 will include students in all procedures. The Register Committee however noted that students are at the time not included in this procedure, as the new system is not implemented yet. The Register Committee underlined the expectation of the standard, that
students should be involved in all QA processes.
22. The Register Committee concurs with the panel that AIC complies only partially with ESG 2.4.”
Full decision: see agency register entry
-
2.4 Peer-review experts – MFHEA – Partial compliance (2024) students
MFHEA
Application Initial Review Full, coordinated by ENQA Decision of 11/10/2024 Standard 2.4 Peer-review experts Keywords students Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “26. The Register Committee learned from the analysis of the panel that at the time of the review, some provider and programme accreditation procedures did not involve experts and that these procedures were conducted by MFHEA’s staff. The Committee understood that the only reviews that involved panels were the accreditation procedures for provider seeking university status and EQA Audit (see also ESG 2.3).
27. In its statement to the report, MFHEA informed that the revised manuals, referenced earlier in this decision, require that now every procedure is conducted by an external review panel of a minimum of three experts out of whom one is a student.
28. The Register Committee took note of the actions taken by the agency. Nevertheless, the Committee could not confirm whether these changes have been implemented in practice.
29. In its additional representation, MFHEA referred to the new manuals for provider and programme accreditation where the involvement of students in every external review panel will be guaranteed. Furthermore, MFHEA informed that despite that, the new Programme Accreditation Manual would be in place as of January 2025, the agency already includes students in the review panels for programme accreditation procedures.
30. From the additional representation, the Committee has learned that at the given time only a very small portion of programme accreditation reports are available on MFHEA’s website and further publication of reports is planned in January 2025 (see ESG 2.6). From the limited number of reports available online, the Committee could see that the agency started including a student reviewer in the expert panel.
31. The Register Committee welcomed the changes made by the agency in order to involve students in all external review procedures and encouraged MFHEA to continue this practice. The Committee, however, found that it remains to be evaluated by an external panel whether the planned changes have been consistently implemented and students are included in all programme review panels once the new programme accreditation manual is adopted. Therefore, the Committee concurred with the panel that the agency complies only partially with the standard.”
Full decision: see agency register entry
-
2.4 Peer-review experts – A3ES – Partial compliance (2024) Absence of student reviewers; Training of student reviewers
A3ES
Application Renewal Review Targeted, coordinated by ENQA Decision of 02/07/2024 Standard 2.4 Peer-review experts Keywords Absence of student reviewers; Training of student reviewers Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “10. In its previous decision for renewal of registration on EQAR (of 2024-11-05), A3ES was found to be partially compliant with the standard due to the absence of student reviewers in panels in the New Study Programmes (NCE) procedures and overseas accreditations. The Register Committee noted from the panel analysis that the status quo has not changed.
11. Furthermore, the Committee understood that except for initial trainings, the agency does not organise systematic training for new or revised processes and that some reviewers, including students, have not received training in the past five years. Furthermore, the Committee understood that student reviewers receive only training for programme reviews, but not for institutional reviews.
12. Given the lack of students involvement in some procedures and the lack of systemic training for reviewers, the Register Committee concurred with the panel conclusion, and found that A3ES remains to be partially compliant with ESG 2.4.”
Full decision: see agency register entry
-
2.4 Peer-review experts – AQUIB – Partial compliance (2024) Peer-review experts
AQUIB
Application Initial Review Full, coordinated by ENQA Decision of 27/11/2024 Standard 2.4 Peer-review experts Keywords Peer-review experts Panel conclusion Compliance Clarification request(s) – RC decision Partial compliance “11. The Register Committee learned from the panel’s analysis that, in the ex-post accreditation reviews are collaborative effort between the panel and the Commission of Study Programmes Evaluation (CET). In particular, the Criterion 3 of the methodology is pre-evaluated by a member of the CET. Even though it is not currently the practice, these members can also participate in the external site visit.
12. The Register Committee shared the panel’s concerns that the current set up in which the CET members are participating both in the external evaluation and the decision making on the final outcomes of the review may lead to a potential conflict of interest. Further, the Register Committee noted that this arrangement is contrary to the requirement that external quality assurance is conducted by a group of external experts.
13. The Register Committee also learned that follow-up activities are not conducted by panels, but directly by CET sub-commissions. CET sub-commission includes a chairperson, two academic members, one student member and one quality spokesperson.
14. Given the above mentioned issues, the Register Committee was unable to concur with the panel’s conclusion of compliance and found that AQUIB only partially complies with the standard.”
Full decision: see agency register entry
-
2.4 Peer-review experts – AIC – Compliance (2025) student involvement
AIC
Application Renewal Review Focused, coordinated by ENQA Decision of 14/03/2025 Standard 2.4 Peer-review experts Keywords student involvement Panel conclusion Compliance Clarification request(s) – RC decision Compliance “11. In its decision of 2023-12-12, the Register Committee found AIC to be partially compliant with the standard, due to lack of involvement of students in the review panels in its procedure Inclusion of licensed study programme on the accreditation of study fields. The Register Committee understood from the review report that as AIC moves towards a system focused on cyclical institutional reviews, it has discontinued this activity and no future reviews of this kind will be implemented.
12. The Register Committee considered that since the agency has discontinued the activity, the conditions leading to partial compliance have ceased to exist. The Register Committee could therefore follow the panel’s judgement and found the agency to be compliant with the standard.”
Full decision: see agency register entry
-
2.4 Peer-review experts – THEQC – Compliance (2025) remunerating of experts,
THEQC
Application Renewal Review Full, coordinated by ENQA Decision of 27/06/2025 Standard 2.4 Peer-review experts Keywords remunerating of experts, Panel conclusion Compliance Clarification request(s) – RC decision Compliance “11. The Register Committee noted that all external quality assurance activity are carried out by an expert panel, including students. The Committee, however, learned that while students are currently involved in every panel their involvement is not made explicit in any internal documentation.
12. The Committee further learned that the experts perform their duties on voluntary basis without receiving any financial support for their work.
13. While the Register Committee concurred with the panel’s judgement that the agency continues to comply with the standard, it underlined the panel’s recommendation that student involvement in expert panels should be ensured by mandating it in the agency’s rules and regulations. The Committee further underlined the panels recommendation that the agency should explore ways of remunerating experts for their work.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – SKVC – Partial compliance (2022) lack of consistency, unclear understanding of multi-level compliance scale
SKVC
Application Renewal Review Targeted, coordinated by ENQA Decision of 25/10/2022 Standard 2.5 Criteria for outcomes Keywords lack of consistency, unclear understanding of multi-level compliance scale Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “8.The panel considered that SKVC's criteria are lacking clarity, especially with regard to the exact understanding of the 5-level scale used by SKVC. The panel recommended developing guidelines for interpretation of each level to enhance consistency of their use.
9.The Committee understood that the current situation as described and analysed by the panel might lead to a lack of consistency.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – AHPGS – Compliance (2020) transparency of criteria
AHPGS
Application Renewal Review Full, coordinated by ENQA Decision of 16/03/2020 Standard 2.5 Criteria for outcomes Keywords transparency of criteria Panel conclusion Full compliance Clarification request(s) – RC decision Compliance “29. The Register Committee took note of the panel's analysis that the criteria are well-documented in AHPGS' handbooks and are interpreted in a consistent manner.
30. Despite some room for improvement identified by the panel in that the Handbooks could be more detailed, the Register Committee considered that the flag was addressed and concurred with the panel's conclusion that AHPGS complies with the standard.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – SQAA – Compliance (2019) clarity of the criteria for assessment
SQAA
Application Renewal Review Full, coordinated by ENQA Decision of 03/04/2019 Standard 2.5 Criteria for outcomes Keywords clarity of the criteria for assessment Panel conclusion Substantial compliance Clarification request(s) Panel (15/03/2019)
RC decision Compliance “Following the review panel's analysis that SQAA's criteria for assessment were not always clear and left room for interpretation, the Register Committee sought and received clarification from the panel on its conclusion as to the present standard. The Register Committee understood that SQAA's criteria were by and large perceived as clear, and that these remarks related to some – but not all or the majority of – criteria. It became clear that the panel's findings were more nuanced than the language might have suggested.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – EAEVE – Partial compliance (2018) consistency in decision making
EAEVE
Application Initial Review Full, coordinated by ENQA Decision of 13/06/2018 Standard 2.5 Criteria for outcomes Keywords consistency in decision making Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The Register Committee took note of the panel's analysis that the evidence in the report body does not always match the conclusion as to compliance with certain standards, and that it was not always possible to track all the information required by the standards in the text of the reports. The Register Committee understood that this might in part be a result of the duplication caused by the “add-on” way of incorporating the ESG.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – NVAO – Compliance (2017) decision making
NVAO
Application Renewal Review Full, coordinated by ENQA Decision of 16/11/2017 Standard 2.5 Criteria for outcomes Keywords decision making Panel conclusion Substantial compliance Clarification request(s) – RC decision Compliance “In its last renewal decision (of 1/12/2012), the Register Committee flagged for attention the criteria for outcomes on the accreditation of existing programmes and in particular the consistency of decisions based on reviews undertaken by different agencies.The panel stated that NVAO has taken a number of steps to improve the decision-making process and found that there has been good progress in clarifying criteria for outcomes. The panel further underlined the difficulty of grading outcomes from insufficient to excellent on which further reflection by NVAO will be needed.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – ANQA – Partial compliance (2017) criteria not published fully
ANQA
Application Initial Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 2.5 Criteria for outcomes Keywords criteria not published fully Panel conclusion Substantial compliance Clarification request(s) – RC decision Partial compliance “The review panel noted that ANQA's evaluation protocols, containing additional details about its standards, and the decision rules, used by the Accreditation Committee to differentiate their different possible accreditation decisions, are not published; the panel recommended that they be published.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – HCERES – Partial compliance (2017) lack of consistent application of criteria for institutional evaluations; lack of criteria for evaluation of study fields
HCERES
Application Renewal Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 2.5 Criteria for outcomes Keywords lack of consistent application of criteria for institutional evaluations; lack of criteria for evaluation of study fields Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “With regard to institutional evaluations the panel noted that the application of criteria for outcomes leaves too much room for interpretation and therefore undermines the consistent application of criteria. Considering the agency’s transitioning to evaluation of study fields the review panel further highlighted the need for development of criteria for the outcomes of subject level evaluations.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – ASHE – Partial compliance (2017) lack of transparency in criteria; inconsistency in the application of critera; insufficient documentation for interpretation of criteria
ASHE
Application Renewal Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 2.5 Criteria for outcomes Keywords lack of transparency in criteria; inconsistency in the application of critera; insufficient documentation for interpretation of criteria Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The review panel identified that some policies that affect ASHE's decision-making are not fully transparent and known by the stakeholders concerned. The panel further referred to some inconsistency in the application of ASHE's criteria and an insufficiency of the reference documents that panels use to interpret the criteria.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – MusiQuE – Compliance (2016) clarity in decision making
MusiQuE
Application Initial Review Full, coordinated by NASM Decision of 06/06/2016 Standard 2.5 Criteria for outcomes Keywords clarity in decision making Panel conclusion Full compliance Clarification request(s) Panel (26/10/2025)
RC decision Compliance “The External Review Report did not address in detail the clarity and transparency of the decision-making process in those cases where the MusiQuE Board’s decision differs from the experts’ recommendation.The Register Committee considered the clarification received from the Review Panel (Annex 7), explaining that the Panel had analysed the process followed in case the MusiQuE Board requires clarification or disagrees with the recommendation of the experts, and found that process adequate, clear and transparent.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – QAA – Partial compliance (2023) lack of a body to ensure consistency of outcomes
QAA
Application Renewal Review Full, coordinated by ENQA Decision of 13/10/2023 Standard 2.5 Criteria for outcomes Keywords lack of a body to ensure consistency of outcomes Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “14. The Register Committee understood from the review panel’s analysis that there is no independent commission that reviews and checks all reports and their application across the agency, which may question whether criteria are being applied uniformly.
15. The Register Committee concurs with the panel’s recommendation that QAA should strongly reflect on its approach to ensuring the consistency of outcomes including the potential need to establish an independent commission that validates reports and makes the final decision.”
Full decision: see agency register entry
-
2.5 Criteria for outcomes – GAC – Partial compliance (2022) lack of formal mechanisms for consistency, unclear whether or not consistency improved
GAC
Application Initial Review Full, coordinated by ENQA Decision of 25/10/2022 Standard 2.5 Criteria for outcomes Keywords lack of formal mechanisms for consistency, unclear whether or not consistency improved Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “12. The panel considered critically the lack of formal mechanisms to ensure a consistent understanding and application of the criteria (e.g. guidelines, interpretations or a precedent database made available by GAC).
13. The panel was unable to draw a conclusion whether the post-2018 system – with decisions made by GAC, including the practice to change conditions deviating from the proposal by the expert panels – actually delivered a higher degree of consistency or not.
14. The panel further noted that the current organisation of the Council's work included the risk that analysis of cases might often be “monopolised” in the hands of a single (academic) Council member, while some other Council members are currently not participating in the preparatory work as rapporteurs.”
Full decision: see agency register entry