Database of Precedents
-
3.4 Thematic analysis – AQAS – Partial compliance (2022) Content of the thematic analysis
AQAS
Application Renewal Review Full, coordinated by ENQA Decision of 14/03/2022 Standard 3.4 Thematic analysis Keywords Content of the thematic analysis Panel conclusion Substantial compliance Clarification request(s) – RC decision Partial compliance “the content of the thematic publications mainly involved reflections on the agency’s own experiences in conducting EQA rather than analysis of the results of the EQA (an analysis which could be more appropriate to serve the internal quality assurance processes, ESG 3.6). The Committee agreed with the panel’s views that the agency could improve the content of the analyses so they are more meaningful for the wider academic and QA community”
Full decision: see agency register entry
-
3.4 Thematic analysis – AKAST – Partial compliance (2021) Lack of development in preparing thematic analysis
AKAST
Application Initial Review Focused, coordinated by GAC Decision of 12/12/2021 Standard 3.4 Thematic analysis Keywords Lack of development in preparing thematic analysis Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “7. The panel notes that AKAST reliably contributes the experience gained from its own quality assurance procedures to the regular evaluation of the Key Points and that the agency is documenting the results of its ongoing student survey on its website.
18. The Register Committee welcomes AKAST’s plan to further develop a thematic analysis after an appropriate number of programme accreditation procedures have been completed, but underlined that such an analysis has not been finalised.
19. Considering the limited development of thematic analysis, the Register Committee can follow the review panel conclusion that AKAST complies only partially with ESG 3.4.”
Full decision: see agency register entry
-
3.4 Thematic analysis – HCERES – Partial compliance (2022) separate research or bilbiometric analyses do not qualify as thematic analysis
HCERES
Application Renewal Review Full, coordinated by ENQA Decision of 28/06/2022 Standard 3.4 Thematic analysis Keywords separate research or bilbiometric analyses do not qualify as thematic analysis Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “38. The panel considered that HCERES' recent activities have been focused on research and bibliometric analysis; analyses drawing on the results of evaluations within the scope of the ESG have not been produced regularly since the summary reports that HCERES/AERES used to produce following earlier evaluation campaigns.”
Full decision: see agency register entry
-
3.4 Thematic analysis – IQAA – Compliance (2022) Consistent publication of thematic analyses
IQAA
Application Renewal Review Full, coordinated by ENQA Decision of 25/10/2022 Standard 3.4 Thematic analysis Keywords Consistent publication of thematic analyses Panel conclusion Partial compliance Clarification request(s) – RC decision Compliance “The Register Committee learned that IQAA has published several thematic analyses since the last review. The panel, however, could not see
any formal plan for drafting and publishing these analyses.The Committee considered that despite the absence of a more formal planning the agency has developed a practice and demonstrated a clear vision for conducting analyses based on its EQA processes.”
Full decision: see agency register entry
-
3.4 Thematic analysis – QANU – Compliance (2019) Introduced policy for thematic analysis
QANU
Application Renewal Review Focused, coordinated by ENQA Decision of 19/06/2019 Standard 3.4 Thematic analysis Keywords Introduced policy for thematic analysis Panel conclusion Full compliance Clarification request(s) – RC decision Compliance “The Register Committee learned that QANU approved a new policy for thematic analysis in October 2018, which defines explicit aims and objectives for various analysis. The panel stressed that QANU acknowledged its responsibility for producing thematic analysis as a way of contributing to the further development of the university research sector in the Netherlands. The panel further added that QANU has demonstrated capacity to use the experiences it gathered, to reflect on them, to share them and to publish outcomes through thematic analysis. Following the evidence and analysis provided by the panel, the Register Committee concurred with the panel’s conclusion that QANU now complies with ESG 3.4.”
Full decision: see agency register entry
-
3.4 Thematic analysis – madri+d – Partial compliance (2020) absence of regular analysis based on agency’s findings
madri+d
Application Renewal Review Full, coordinated by ENQA Decision of 22/06/2020 Standard 3.4 Thematic analysis Keywords absence of regular analysis based on agency’s findings Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The panel specifically recommended that the agency “publishes reports of thematic analysis every year”. While the standard requires that such analyses be published "regularly”, it does not impose a specific cycle.
The Register Committee therefore underlined that this recommendation should rather be considered a suggestion.”
Full decision: see agency register entry
-
3.4 Thematic analysis – BAC – Partial compliance (2020) Lack of systematic approach to thematic analysis; Quality of analysis
BAC
Application Renewal Review Full, coordinated by ENQA Decision of 02/11/2020 Standard 3.4 Thematic analysis Keywords Lack of systematic approach to thematic analysis; Quality of analysis Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The review panel found that BAC’s thematic review report provided a limited analysis, and was rather descriptive by simply summarising the content of inspection reports. Overall, the review panel felt there were still significant weaknesses in BAC’s approach to thematic analysis. In its additional representation, BAC agreed with the assessment of the panel and committed to prepare more meaningful thematic analysis that will serve to improve key areas related to the agency’s work by January 2021.While the Register Committee acknowledged the agency’s work towards improving its thematic analysis, the Committee remarked that such changes have not yet been implemented.”
Full decision: see agency register entry
-
3.4 Thematic analysis – AKKORK – Partial compliance (2020) Lack of systematic approach to thematic analysis; Absence of regular analysis;
AKKORK
Application Renewal Review Full, coordinated by ENQA Decision of 22/06/2020 Standard 3.4 Thematic analysis Keywords Lack of systematic approach to thematic analysis; Absence of regular analysis; Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The Register Committee noted that the agency has produced two analyses since its last review in 2014, both written in Russian but only published on the English version of AKKORK’s website. According to the panel, the last publication, however, does not meet the requirements of a thematic analysis. In particular, the panel noted the great qualitative difference between the publications, indicating a missing systematic approach to the publication of thematic analysis. The Register Committee underlines the panel’s recommendation that the agency should establish a clear process to address all of its activities in thematic analyses. ”
Full decision: see agency register entry
-
3.4 Thematic analysis – QQI – Compliance (2019) Producing effective thematic analysis reports
QQI
Application Renewal Review Full, coordinated by ENQA Decision of 05/11/2019 Standard 3.4 Thematic analysis Keywords Producing effective thematic analysis reports Panel conclusion Full compliance Clarification request(s) – RC decision Compliance “In its decision of 2015 to admit QQI to the Register, the Register Committee flagged for attention the production of thematic analyses by QQI.The Register Committee understood from the panel's report that QQI has been proactive and effective in producing a range of thematic analysis reports, which are considered useful in the sector for improving quality and quality assurance, even though not having completed full cycles in all external quality assurance activities.The Register Committee therefore considered that the flag has been addressed and concurred with the panel's conclusion that QQI complies withthe standard.”
Full decision: see agency register entry
-
3.4 Thematic analysis – EVALAG – Compliance (2019) Producing effective thematic analysis reports
EVALAG
Application Renewal Review Full, coordinated by ENQA Decision of 05/11/2019 Standard 3.4 Thematic analysis Keywords Producing effective thematic analysis reports Panel conclusion Full compliance Clarification request(s) – RC decision Compliance “When evalag’s registration was last renewed, the Register Committee noted that the current review should address whether evalag produced analyses of the general findings of all reviews carried out by the agency. The review panel described clearly how evalag conducts thematic analyses based on the findings from its reviews. The Register Committee therefore concluded that the flag has been addressed.”
Full decision: see agency register entry
-
3.4 Thematic analysis – Unibasq – Compliance (2019)
Unibasq
Application Renewal Review Full, coordinated by ENQA Decision of 05/11/2019 Standard 3.4 Thematic analysis Keywords Panel conclusion Substantial compliance Clarification request(s) – RC decision Compliance “In the previous review the panel found that Unibasq had yet to produce a system-wide analysis and there was a lack of sufficient resources which is why this standard was flagged.The panel recognised that Unibasq has made clear progress in this area in recent years. The reports that agency produces show a clear shift from the evaluation of the procedures to a genuine thematic analysis (see page 24 of the report).The Committee concluded that the flag has been addressed and concurred with the review panel’s conclusion that Unibasq complies with the standard.”
Full decision: see agency register entry
-
3.4 Thematic analysis – AQ Austria – Compliance (2019) Producing effective thematic analysis reports
AQ Austria
Application Renewal Review Full, coordinated by ENQA Decision of 05/11/2019 Standard 3.4 Thematic analysis Keywords Producing effective thematic analysis reports Panel conclusion Substantial compliance Clarification request(s) – RC decision Compliance “At the time of its previous review in 2014, the Register Committee noted that AQ Austria was working on its first thematic analysis report on the development of quality assurance in Austria, and has not yet produced documentation to evidence substantial compliance. In its 2019 review report the panel’s findings show that the agency has since produced a number of reports focused on the results of QA processes and related issues in higher education. While the Register Committee underlined the recommendations of the panel for a further development of the thematic analysis, the Register Committee concluded that the flag has been satisfactorily addressed.”
Full decision: see agency register entry
-
3.4 Thematic analysis – SQAA – Partial compliance (2019) Implementation of thematic analysis
SQAA
Application Renewal Review Full, coordinated by ENQA Decision of 03/04/2019 Standard 3.4 Thematic analysis Keywords Implementation of thematic analysis Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The Register Committee considered the panel's analysis as well as SQAA's statement on the panel report, referring to its recently published “methodology and procedure for drafting and disseminating system-wide and thematic analyses”. While the Committee welcomed the steps taken by SQAA to swiftly address the panel's recommendation, their actual implementation remains to be analysed within the next external review of SQAA.”
Full decision: see agency register entry
-
3.4 Thematic analysis – AQAS – Partial compliance (2017) systematic approach to analyses and publishing
AQAS
Application Renewal Review Full, coordinated by GAC Decision of 20/06/2017 Standard 3.4 Thematic analysis Keywords systematic approach to analyses and publishing Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “When AQAS last had its registration renewed, the publication of thematic analyses was flagged. Considering the review report, the Register Committee concluded that AQAS carried out a number of relevant internal analyses and produced relevant reports, e.g. the overarching report produced based on its accreditations in Moldova. These were, however, carried out on an ad-hoc basis, internal and not published as required by the standard. In its statement on the review report, AQAS explained that it had published a first set of thematic analyses on its website. While the Register Committee welcomed the efforts taken to date, it was not yet possible to conclude whether thematic analyses are produced regularly.”
Full decision: see agency register entry
-
3.4 Thematic analysis – FINEEC – Partial compliance (2017) Lack of thematic analyeses
FINEEC
Application Renewal Review Full, coordinated by ENQA Decision of 20/06/2017 Standard 3.4 Thematic analysis Keywords Lack of thematic analyeses Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “While a number of thematic analyses have been published since the last external review of the agency, the panel found that the analyses have been paused since the merger of FINHEEC into FINEEC. The panel also noted that FINEEC has not yet initiated thematic analyses of the accreditations of engineering degree programmes due to the small number of finished accreditations. ”
Full decision: see agency register entry
-
3.4 Thematic analysis – ACPUA – Partial compliance (2016) Lack of systematic approach/lack of resources
ACPUA
Application Initial Review Full, coordinated by ENQA Decision of 03/12/2016 Standard 3.4 Thematic analysis Keywords Lack of systematic approach/lack of resources Panel conclusion Substantial compliance Clarification request(s) – RC decision Partial compliance “The panel stated that ACPUA has focused on thematic reports during its first year of existence, however the constraints on human and financial resources have hindered the agency’s activity in this area in recent years. Considering the increased number of external quality assurance activities carried out by ACPUA in recent years, the Register Committee underlined the panel’s recommendation to allocate sufficient resources to the activities supporting thematic analysis and ensure their implementation in a more systematic way”
Full decision: see agency register entry
-
3.4 Thematic analysis – HAHE – Compliance (2023) Content of the thematic analysis
HAHE
Application Initial Review Full, coordinated by ENQA Decision of 03/03/2023 Standard 3.4 Thematic analysis Keywords Content of the thematic analysis Panel conclusion Partial compliance Clarification request(s) – RC decision Compliance “From several Annual reports of the agency from recent years, the Committee learned that the agency provides key figures on its work, but
also provides an in-depth overview of the compliance levels per standard in the undertaken accreditation procedures, summarises the good practices and obstacles observed in HEIs, and presents the most common recommendations by the panels.Following this, the Register Committee found that the current practice fulfils the minimum ESG criteria”
Full decision: see agency register entry
-
3.4 Thematic analysis – CAAAE – Partial compliance (2023) Performing thematic analysis
CAAAE
Application Initial Review Full, coordinated by ENQA Decision of 13/10/2023 Standard 3.4 Thematic analysis Keywords Performing thematic analysis Panel conclusion Partial compliance Clarification request(s) – RC decision Partial compliance “The agency does reports covering different
topics – however they are mostly related to projects, rather than findings
from the external quality assurance activities. The panel further highlighted
that the agency is aware of the importance of collecting and analysing data
from the review processes for its own development purposes, but also for
contributing to the system level policies. The Committee acknowledged that while the thematic analyses are
not taking place in a systemic and formal manner, KAZSEE is a relatively
new agency that demonstrates interest to further formalise the processes
for producing thematic analyses.”
Full decision: see agency register entry
-
3.4 Thematic analysis – ANVUR – Compliance (2025) Use of external QA results
ANVUR
Application Initial Review Full, coordinated by ENQA Decision of 14/03/2025 Standard 3.4 Thematic analysis Keywords Use of external QA results Panel conclusion Compliance Clarification request(s) – RC decision Compliance “31. The Register Committee noted that ANVUR’s main channel for publishing the thematic analysis is the Biennial Report on the State of the Italian Higher Education and Research System. In addition, ANVUR conducts several ad hoc research initiatives on topics relevant for the Italian higher education system.
32. The Register Committee followed the panel’s conclusion that the agency complies with the standard. The Committee, however, emphasised the panel’s recommendation that ANVUR could use the findings and analyses of its external quality assurance processes more systematically and critically in its thematic analyses.”
Full decision: see agency register entry
-
3.4 Thematic analysis – GAC – Compliance (2022) relevance of topics, nature of topics to qualify, regularity and frequency of analyses
GAC
Application Initial Review Full, coordinated by ENQA Decision of 25/10/2022 Standard 3.4 Thematic analysis Keywords relevance of topics, nature of topics to qualify, regularity and frequency of analyses Panel conclusion Partial compliance Clarification request(s) – RC decision Compliance “20. The panel discussed the analyses produced by GAC on various topics, with the most recent ones focusing on conditions imposed on higher education institutions/programmes in decisions by the agencies and by GAC, published in 2018 and 2020 respectively. While the panel questioned whether this was “a crucial topic in the development of the HE system”, the Register Committee considered that such an analysis is certainly based on the general findings of GAC's external quality assurance activities and thus meets the expectation of the standard. Moreover, while the panel did not specifically indicate whether stakeholders found the topic relevant, an analysis of conditions might show how the accreditation criteria resonate with the sector and indicate topics that are typically challenging for institutions and programmes, and hence be relevant beyond GAC.
21. Given the role of GAC as the central body of the German accreditation system, the panel considered that the current publishing rate (one paper per year) was “insufficient”. As the standard remains completely open as to the frequency of analysis, the Register Committee found it an overly strict interpretation of the standard to influence the compliance level on that basis; the remark should rather be seen as a recommendation to publish more analyses.”
Full decision: see agency register entry