Database of Precedents
-
2.3 Implementing processes – ASIIN – Partial compliance (2017) inconsistency in implementation of the process; unclear definition for cases where there is no site visit.
ASIIN
Application Renewal Review Full, coordinated by GAC Decision of 20/06/2017 Standard 2.3 Implementing processes Keywords inconsistency in implementation of the process; unclear definition for cases where there is no site visit. Panel conclusion Substantial compliance Clarification request(s) – RC decision Partial compliance “The review report noted that on-site visits are not mandatory in evaluations (type 1) and recommends that ASIIN should establish clear principles to state in which cases on-site visits are not necessary. Given the current absence of such principles, the Register Committee considered that ASIIN did not comply with the requirement to normally include a site visit. In its additional representation, ASIIN specified that site visits were a mandatory element in all type-1 evaluations. While the Register Committee welcomed the clarification, it underlined that the clear implementation in practice cannot be assessed at this stage; it should thus be subject of the next external review of ASIIN. The review report further identified cases where ASIIN did not follow the principles established in its own policy regarding the use of evaluation results for programme accreditation. The Register Committee took note of ASIIN’s statement on the report, which confirms that fact but does not include an explanation or rationale for departing from the policy. The Register Committee therefore considered that ASIIN did not implement its own processes consistently in all areas. Despite the fact that ASIIN stated in its additional representation that this was “one case among hundreds of procedures” and announced that it was planning to amend its own policy to the effect that a prior evaluation result could be used, provided is is not older than 2 years, the Register Committee noted that ASIIN's current policies were not always followed in practice, even if this was so in only very few cases.”
Full decision: see agency register entry
-
2.3 Implementing processes – AAQ – Partial compliance (2016) Lack of transparency and precise roles in criteria and procedure for selection of experts and guidelines for decision-making process.
AAQ
Application Renewal Review Full, coordinated by GAC Decision of 03/12/2016 Standard 2.3 Implementing processes Keywords Lack of transparency and precise roles in criteria and procedure for selection of experts and guidelines for decision-making process. Panel conclusion Substantial compliance Clarification request(s) Panel (23/05/2025)
RC decision Partial compliance “While the external review report states that AAQ and SAR function well together as a unit, the external review panel considered that the “allocation of duties should be presented with greater transparency in the relevant guidelines” (p. 25). The Register Committee noted that further comments regarding a certain lack of transparency of the precise roles of AAQ and SAR were made by the panel with regard to the criteria and procedure for selection of experts (see 2.4) as well as guidelines for SAR’s decision deviating from the expert-recommended decisions (see 2.5).The Register Committee considered that transparency is crucial especially in a layered system such as that of AAQ and SAR.”
Full decision: see agency register entry
-
2.3 Implementing processes – HAKA – Compliance (2023) study programme groups
HAKA
Application Renewal Review Targeted, coordinated by ENQA Decision of 30/06/2023 Standard 2.3 Implementing processes Keywords study programme groups Panel conclusion Compliance Clarification request(s) – RC decision Compliance “The Register Committee found the difference between the initial and re-assessments of study programme groups on the one hand and the phasing out of assessments of study programme groups on the other hand not to be completely clear.
The agency explained (see clarification of 2023-06-06) that the initial and re-assessment procedures remain compulsory for the opening of any new study programme groups. For existing study programme groups that have gone successfully through multiple assessment processes, the assessments of individual study programme groups are being phased out for a sample of these programmes, within the new model for institutional accreditations.
Having considered the agency’s explanation and the implementation of the new procedures, the Register Committee concurs with the panel’s conclusion of compliance.”
Full decision: see agency register entry
-
2.3 Implementing processes – PKA – Compliance (2024) follow-up, online procedures,
PKA
Application Renewal Review Targeted, coordinated by ENQA Decision of 04/04/2024 Standard 2.3 Implementing processes Keywords follow-up, online procedures, Panel conclusion Partial compliance Clarification request(s) Panel (04/10/2023)
RC decision Compliance “12. The Register Committee noted that PKA does not have separate follow-up mechanisms in place, but that they are part of the re-accreditation process i.e., after a conditional two year period (or longer depending on the length of the study cycle) the agency monitors the implementation of recommendations, while in case of a six year accreditation cycle, the agency monitors if the recommendations for improving the quality of education are addressed.
13. The Register Committee finds this approach completely reasonable and in line with the requirement of the standard
14. The Register Committee noted that all of PKA’s evaluation procedures (with some exceptions) are being carried out remotely. In its clarification call the review panel explained that PKA is following clear regulations regarding its remote procedures, regulations that have been updated following wide consultations with the sector. The panel was reassured with PKA’s approach in its online accreditation procedure i.e., PKA carries out observations of classes, institutions are asked to provide a video of the learning facilities and during the remote visit PKA experts also meet with different stakeholders to verify the facts in the review report.
15. The Register Committee further noted concerns from the review panel’s analysis regarding the factual accuracy-check of review reports, as this practice was not clear for those the review panel interviewed. The Register Committee however noted that the possibility for the higher education institution to comment on the assessment report is given to all higher education institutions (as confirmed by the panel) and that this is part of the procedure of the agency in the consideration of the report. The Register Committee nevertheless underlines the panel’s recommendation to further clarify the stage of factual accuracy check in PKA’s procedures.
16. Having considered the clarification of the panel and PKA’s statement to the review report, the Register Committee could not concur with the review panel’s decision of partial compliance, and found that the agency is in fact compliant with ESG 2.3.”
Full decision: see agency register entry
-
2.3 Implementing processes – AIC – Compliance (2023) inconsistencies in the implementation
AIC
Application Renewal Review Full, coordinated by ENQA Decision of 12/12/2023 Standard 2.3 Implementing processes Keywords inconsistencies in the implementation Panel conclusion Compliance Clarification request(s) – RC decision Compliance “13. The Register Committee noted that there are inconsistencies in the implementation of the processes. The Register Committee underlines the panel’s recommendation that the agency should clearly communicate on the valid reasons behind multiple inputs to its accreditation process and decisions, by publishing them on the website as noted also in its Substantive Change Report Decision of 15 October 2021.
14. The Register Committee further noted the concerns raised by the review panel concerning the lack of relevant criteria and information integrated in AIC’s guidebook from the Law on Higher Education and Cabinet Regulations, as well as the updating of assessment methodologies, frameworks and the guidelines for institutions, as well as experts.
15. From the additional representation by the agency, the Register Committee understood that, when considering that different procedures would be considered as a package the Methodology for organising the assessment of higher education institutions and colleges could be seen as a follow-up procedure for the one-off procedure Accreditation of higher education institutions. While the panel noted that the agency is preparing a cyclical institutional accreditation, the Committee reiterates the need for clear follow-up measures.
16. The Register Committee concluded that AIC complies with ESG 2.3.”
Full decision: see agency register entry
-
2.3 Implementing processes – MFHEA – Partial compliance (2024) no site visits, inconsistency,
MFHEA
Application Initial Review Full, coordinated by ENQA Decision of 11/10/2024 Standard 2.3 Implementing processes Keywords no site visits, inconsistency, Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “20. The Register Committee learned from the analysis of the panel that only the EQA Audit process is clearly outlined in the audit manual. For the rest of the activities, both the information provided to the panel as well as the publicly available documents, were not always consistent.
21. The Committee noted the panel’s concerns on a number of shortcomings related to the programme and provider accreditation
procedures, such as short application forms instead of self-evaluation reports for some procedures, no site-visits (see also ESG 2.2) and lack of consistent follow-up.
22. In its statement on the report (of 2024-05-20), MFHEA informed that the discrepancies between the documents and the shortcomings related to programme and provider accreditation procedures have been further addressed in the revised manuals for programme and provider accreditation procedures, which have been in use as of January 2024 for provider accreditation procedures and will be, respectively, as of January 2025, for programme accreditation procedures.
23. The Register Committee took note of the revised manuals but could not confirm whether and how these changes are implemented in practice.
24. In its additional representation, the agency reaffirmed that the concerns raised by the Committee for provider accreditation procedures have been addressed in the new Provider Accreditation Manual and the concerns for programme accreditation procedures will be addressed in the new Programme Accreditation Manual.
25. The Register Committee took in consideration the actions taken by the agency in order to address the concerns raised by the panel and the Register Committee. The Committee, however, could not confirm how these changes have been implemented in practice without a panel insight and found that some of them are yet to be implemented. Therefore, the Committee could concur with the panel that the agency complies only partially with the standard.”
Full decision: see agency register entry
-
2.3 Implementing processes – ANVUR – Compliance (2025) Difficulties in verifying that all procedures are pre-defined and published
ANVUR
Application Initial Review Full, coordinated by ENQA Decision of 14/03/2025 Standard 2.3 Implementing processes Keywords Difficulties in verifying that all procedures are pre-defined and published Panel conclusion Compliance Clarification request(s) – RC decision Compliance “16. The Register Committee understood that although ANVUR generally implements all stages of the review (self-assessment, site visit, report, follow-up), there are certain exceptions: site visits are not mandatory in the initial (ex ante) accreditation while the follow-up of the newly accredited institutions is only conducted via the periodic assessments.
17. The Register Committee learned from the analysis of the panel that ANVUR is lacking a comprehensive and published description for each external quality assurance procedure that would serve as an overarching guide (see also ESG 2.2). Due to this, the agency cannot ensure that its external QA processes are pre-defined and published, which could further endanger the consistent implementation of these processes and of their individual phases.
18. In its additional representation, ANVUR demonstrated that since the site visit, the agency published a Manual which comprehensively compiles, describes and explains all external QA activities of the agency in detail.
19. The Register Committee could verify that now ANVUR’s procedures are pre-defined and published, and was able to concur with the panel’s conclusion that ANVUR complies with ESG 2.3.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – AAQ – Partial compliance (2021) Using feedback for improving methodologies
AAQ
Application Renewal Review Full, coordinated by ENQA Decision of 02/07/2021 Standard 2.2 Designing methodologies fit for purpose Keywords Using feedback for improving methodologies Panel conclusion Substantial compliance Clarification request(s) – RC decision Partial compliance “The Register Committee welcomed the diverse methods used by the agency
for gathering feedback from different stakeholders, but could
not confirm that the reflections are efficiently and systematically used in the
improvement of the activities. The findings indicate that the
feedback is only sporadically used in the improvement of the agency’s
external QA activities.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – AKAST – Compliance (2020) stakeholder involvement in the development of methodology
AKAST
Application Initial Review Full, coordinated by GAC Decision of 22/06/2020 Standard 2.2 Designing methodologies fit for purpose Keywords stakeholder involvement in the development of methodology Panel conclusion Full compliance Clarification request(s) Panel (23/05/2025)
RC decision Compliance “The Register Committee was unclear how the agency has developed its accreditation criteria and whether stakeholders were involved in the design of AKAST methodologies and has therefore asked the panel for further clarifications. The panel explained that Germany’s new legal framework defines the procedures for QA agencies carrying out their accreditations within Germany and that the German Accreditation Council (GAC) is entrusted with overseeing this process. The GAC has issued reporting templates and defined the structure of review reports as well as self-evaluation reports for higher education institutions, following the criteria established in the Specimen Degree, which follow the ESG.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – NEAA – Compliance (2018) flexibility of the accreditaiton system
NEAA
Application Initial Review Full, coordinated by ENQA Decision of 13/06/2018 Standard 2.2 Designing methodologies fit for purpose Keywords flexibility of the accreditaiton system Panel conclusion Full compliance Clarification request(s) – RC decision Compliance “While concurring with the panel's conclusion that NEAA complies with the standard, the Register Committee underlined the suggestion by the panel that NEAA should explore ways to make the accreditation system more flexible.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – MAB – Compliance (2019) fitness for purpose of doctoral schools EQA
MAB
Application Initial Review Full, coordinated by ENQA Decision of 03/04/2019 Standard 2.2 Designing methodologies fit for purpose Keywords fitness for purpose of doctoral schools EQA Panel conclusion Substantial compliance Clarification request(s) – RC decision Compliance “Considering the fitness for purpose of external QA processes, the Register Committee noted the panel’s concerns with the effectiveness of the practice of evaluating doctoral schools every six months. In its additional representation HAC explained that the biannual checking of compliance with criteria for doctoral programmes has now been discontinued and that a new approach and criteria have been developed, which are expected to be finalised in autumn.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – IAAR – Partial compliance (2017) involvement of stakeholders (students)
IAAR
Application Initial Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 2.2 Designing methodologies fit for purpose Keywords involvement of stakeholders (students) Panel conclusion Substantial compliance Clarification request(s) – RC decision Partial compliance “The panel’s analysis showed that while IAAR involved a range of stakeholders in the ongoing review of the agency’s methodology, the panel found no evidence that student representative bodies had been consulted. The panel added that student involvement in IAAR’s relevant consultative and decision-making bodies was minimal.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – AEQES – Compliance (2017) stakeholder involvement
AEQES
Application Renewal Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 2.2 Designing methodologies fit for purpose Keywords stakeholder involvement Panel conclusion Full compliance Clarification request(s) – RC decision Compliance “The review report demonstrated that, based on the national legislation as the main framework, AEQES has developed its own methodological framework, procedures and criteria in consultation with the key stakeholders”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – ANVUR – Compliance (2025) Fitness for purpose difficult to fully assess due to dispersed methodologies
ANVUR
Application Initial Review Full, coordinated by ENQA Decision of 14/03/2025 Standard 2.2 Designing methodologies fit for purpose Keywords Fitness for purpose difficult to fully assess due to dispersed methodologies Panel conclusion Compliance Clarification request(s) – RC decision Compliance “15. At the time of the review the methodologies were dispersed across different documents including ministerial decrees, other regulatory documents, and procedural guidelines, making it challenging to find information on each of the activities in a comprehensive manner. While the Register Committee could follow the panel’s conclusion that the agency complies with the standard it highlighted the panel’s recommendation that the agency should more explicitly define and consistently publish the purpose and aims of each of its external quality assurance activities.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – GAC – Compliance (2022) no ownership or full responsibility resting with a single actor, consequences for improvement
GAC
Application Initial Review Full, coordinated by ENQA Decision of 25/10/2022 Standard 2.2 Designing methodologies fit for purpose Keywords no ownership or full responsibility resting with a single actor, consequences for improvement Panel conclusion Substantial compliance Clarification request(s) Panel (05/10/2022)
RC decision Compliance “9. The panel noted that no actor had ownership or full responsibility for the entire accreditation system and process, since the specimen decree appoints specific responsibilities to both GAC and the agencies.
10. The Register Committee sought further clarification from the panel as to how that impacted continuous improvement and development. The panel noted that opportunities for improvements were discussed actively; the ongoing review of the Specimen Decree was an example of that. The panel, however, saw a lack of GAC itself assuming a more proactive, coordinating role and taking responsibility for the system as a whole; this would be reasonable given its unique and pivotal position.
11. The Register Committee concluded that continuous improvement seems to be ensured despite the distributed responsibilities and thus concurred with the panel's conclusion that GAC complies with standard 2.2; the issues related to GAC's role and strategy are considered under standard 3.1 below.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – AKKORK – Partial compliance (2020) Clarity of activities; lack of stakeholder involvement in the development of methodologies and criteria;
AKKORK
Application Renewal Review Full, coordinated by ENQA Decision of 22/06/2020 Standard 2.2 Designing methodologies fit for purpose Keywords Clarity of activities; lack of stakeholder involvement in the development of methodologies and criteria; Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “Considering the design of AKKORK’s methodology of external QA procedures, the panel noted that the aims of the different activities were not clearly differentiated and that there were inconsistencies between the different language versions of the AKKORK ‘s website (English and Russian). In its additional representation the agency responded that it has made revisions to the information on its website. While the Register Committee could verify the publication of the procedures, the Committee further noted that the agency also has ‘on offer’ the activity quality assurance of educational programmes on the level of higher education and remains to demonstrate that the activity has been defined and designed to achieve the objectives set for it, as required by the standard. The panel further commented on the lack of involvement of external stakeholders, apart from the representatives from its own bodies, in the design and continuous improvement of the offered procedures. The agency commented in its additional representation that it has developed a Regulation on collaboration with partners designed to be implemented in AKKORK’s daily routine. The Register Committee welcomed the thorough work in the development of a cooperation regulation with stakeholders, but could not confirm that the Regulation is already in effect as no evidence of the stakeholders' engagement was provided for in the recent substantive changes introduced by the agency. ”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – EVALAG – Partial compliance (2019) Involvement of students in developing the international accreditation and evaluation processes.
EVALAG
Application Renewal Review Full, coordinated by ENQA Decision of 05/11/2019 Standard 2.2 Designing methodologies fit for purpose Keywords Involvement of students in developing the international accreditation and evaluation processes. Panel conclusion Substantial compliance Clarification request(s) – RC decision Partial compliance “The Register Committee noted that the processes and criteria for evalag’s work outside of the German accreditation system are designed by the Foundation Board. Based on the analysis by the review panel the Committee understood that students have little involvement in designing evalag’s own processes and are also not involved in the Foundation Board (see p. 30).The involvement of students in developing the international accreditation and evaluation processes was a recommendation from the previous ESG review of evalag in 2014, but has not yet been addressed.While the Register Committee welcomed evalag’s commitment expressed in its statement on the review report, no changes have been made as yet. The Committee was therefore unable to concur with the panel’s conclusion of substantial compliance, but considered that evalag only partially complies with the standard.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – NEAQA – Partial compliance (2018) clarity and consistency of standards, decision-making procedure
NEAQA
Application Renewal Review Full, coordinated by ENQA Decision of 06/12/2018 Standard 2.2 Designing methodologies fit for purpose Keywords clarity and consistency of standards, decision-making procedure Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The Register Committee shared the view that NEAQA’s standards would benefit from a revision to ensure full clarity, consistency and readability, in particular in what concerns the employment of site-visits in programme accreditation procedures. The Register Committee concurred with the panel's analysis as regards the arrangement whereby NEAQA’s members combine their decision-making function with that of external experts and with the recommendation to separate these functions. In its additional representation the agency stated that the inherited regulations, procedures and standards of CAQA were revised considering the panel’s concerns and the new by-laws. According to NEAQA particular attention was devoted to ensuring the broader inclusion of external reviewers and the separation of review experts from other member and staff positions in the organisation.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – ASHE – Compliance (2017) overlaping and duplication of processess
ASHE
Application Renewal Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 2.2 Designing methodologies fit for purpose Keywords overlaping and duplication of processess Panel conclusion Substantial compliance Clarification request(s) – RC decision Compliance “In its decision to admit ASHE to the Register, the Register Committee had flagged the need to review ASHE's different processes with a view to avoiding duplication. The Register Committee noted that the review panel remained concerned about different ASHE processes addressing the same or very similar issues. Moreover, the panel appeared to be concerned that the new processes for re-accreditation of doctoral programmes and the possible future processes related to the Croatian Qualifications Framework (CROQF) might even lead to further duplication.The Register Committee therefore concluded that the flag was not addressed and remains a matter deserving the urgent attention of both ASHE and the Croatian Ministry of Science and Education, being responsible for the legal framework of the external quality assurance processes implemented by ASHE.
The Register Committee concluded that all processes deployed by ASHE in themselves are fit for purpose and were developed in line with the standard, while the overlap and duplication identified by the panel is primarily the result of the typology of external quality assurance processes prescribed by law, the Register Committee was nevertheless able to concur with the panel's conclusion that ASHE complies with the standard.”
Full decision: see agency register entry
-
2.2 Designing methodologies fit for purpose – IQAA – Partial compliance (2017) fitness for purpose of IQA’s methodology
IQAA
Application Initial Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 2.2 Designing methodologies fit for purpose Keywords fitness for purpose of IQA’s methodology Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “Considering the fitness for purpose of the agency’s metholodogy, the panel identified a number of shortcomings i.e. lack of a regular review of the agency’s methodology, blurring of boundaries between the agency’s different functions (such as the preliminary review processes and the post-accreditation monitoring process).
In the analysis the panel further underlined the need to shift the responsibility for quality from the agency towards the institution and that the current procedures might be impeding such development. While the Register Committee considered the agency’s statement to the review report, noting the phasing out of preliminary reviews and the clarification regarding post-accreditation reviews, the Committee concluded that the achieved fitness for purpose of IQA’s methodology needs to be externally reviewed.”
Full decision: see agency register entry