Database of Precedents

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	22/06/2020
Standard	2.6 Reporting
Keywords	publication of negative reports
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee noted that AAC-DEVA publishes the full reports of its external reviews, except those with a negative result of its (ex-ante) verification programme. While the review panel found the agency’s explanations – that it is not necessary to publish information about study programmes that are not going to be offered – reasonable, the Register Committee underlined that it can be of interest for the public to know which concepts were denied accreditation and why. In particular, such information is important if the institutions applies for accreditation of the same programme with another quality assurance agency, which needs to be able to find out that it was earlier denied accreditation by AAC-DEVA. In its additional representation the agency stated that it is committed to transparency, but that the publication of the ex ante reports would create confusion among students and might create prejudice against the concerned university. AAC-DEVA added that that the current legal framework in Spain does not allow ex-ante accreditation to be carried out by a different QA agency and that the universities are required to wait at least two years before resubmitting the programme for the ex-ante verification. The Committee however could not follow the agency’s reasoning for not publishing reports where the agency takes a negative decision since such reports have been published in the past by registered agencies (in other regions of Spain and elsewhere), without the risk of confusion. The reputation of a higher education institutions should not be affected by an ex-ante negative report more than the publication of any other report with a negative outcome. The Register Committee added that the higher education institution could always have the option to withdraw the proposal of a study programme before a decision by AAC-DEVA is taken, so as to avoid any public decision from being taken. The Register Committee underlined that the standard requirement is clear, and does not include exceptions in regards to the publication of reports for any form of finalised external QA procedure. ”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	22/06/2020
Standard	2.7 Complaints and appeals
Keywords	Lack of an impartial decision making → lack of an independent appeals committee
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee noted that higher education institutions reviewed by AAC-DEVA may file an appeal before the Universities Council in case of verification/modification, accreditation renewal and institutional accreditation. If the claim is accepted, the appeal is sent to AAC-DEVA where a group of experts who have not intervened in the evaluation that led to the unfavourable decision will revise the report. The Committee underlined that AAC-DEVA’s current appeals process does not fully ensure the impartiality of decision making, as the Universities Council is both the body responsible for the accreditation decisions and the resolution of appeals after such procedures. In case of DOCENTIA, IMPLANTA and the accreditation of foreign language skills, the resolution of the appeal is with the same body who issued the initial decision. Thus the impartiality of the decision making is not fully ensured in any of the external QA activities carried out by the agency. In its additional representation the agency explained that according to the Spanish legal framework the agency cannot exclude the University Council in the consideration of the appeals procedure – in the case of verification/modification, accreditation renewal and institutional accreditation. The appeal is assessed by a commission which includes experts that have not intervened in the evaluation, and following their examination, if the appeal is ratified it will be further submitted to the corresponding evaluation body for reevaluation. The Register Committee noted that AAC-DEVA intends to establish an Appeals Committee to consider all appeals related to the evaluation of programmes. The decision of the Appeals Committee will be binding for the DEVA Director. Furthermore, while higher education institutions have been able to state their dissatisfaction with the review process i.e. by filling in an online ‘suggestions form’, AAC-DEVA lacks a formal procedure that explains what form of complaints may be submitted and considered by the agency. In its additional representation the agency stated that it has designed a specific procedure for complaints as part of its quality management system and that it has updated its online form for the submission of such complaints. The Register Committee could verify that a complaints protocol has been developed and that the modified online form allows the submission of various forms of complaints. ”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	22/06/2020
Standard	3.1 Activities, policy and processes for quality assurance
Keywords	Stakeholders’ involvement; Involvement of students; Lack of strategical planning
Panel conclusion	Partial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee noted the panel’s concerns in terms of the agency’s engagement with stakeholders. While the agency has strong connections with universities, the relationship with student representatives, and other civic and social groups is very weak. This lack of engagement is reflected in both the composition, working arrangements and internal interaction of the agency’s committees. The Register Committee considered the agency’s explanation that the current regulation of its statutes limit the involvement of students, but the Register Committee underlined that stakeholder involvement such as students is a key requirement of the standard. the agency lacked a strategic focus and that there was no evidence of governance level oversight of strategic planning or review by AAC-DEVA. In its additional representation the agency reported that steps have been already made to ensure the presence of students and professionals in all evaluation committees for ex-ante verification, modification and accreditation renewal. The agency stated that it intends to further strengthen the role of the Technical Committee for Evaluation and Accreditation (CTEyA) by incorporating professionals and by increasing the number of students. Considering the lack of a strategic focus and governance oversight, the agency added that its new Strategic Plan for 2021-2026 is in preparation and that it will reflect the engagement of stakeholders and the different levels of strategic governance. ”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	22/06/2020
Standard	3.5 Resources
Keywords	Allocation of resources; Financial sustainability
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Compliance

“In its last decision of inclusion the Register Committee flagged AAC-DEVA’s ability to acquire and consolidate the resources required to organise site-visits as part of its periodic re-accreditation procedures. As AAC-DEVA has been able to carry out site-visits within its procedures, the flag has been addressed. The Register Committee noted that AAC-DEVA acknowledged in its SWOT analysis that it did not achieved what it aspired it set out to do in the past five years. These concerns were mainly due to the current organisational structure of the agency and lack of strategic planning which has lead to difficulties in the proper allocation of resources and development of prospective units for the full implementation of thematic analysis. In its additional representation AAC-DEVA stated that it had been able to provide all the necessary resources to set up and maintain its external QA activities and that its budget has been approved without any reductions. Concerning the problems related to the structural organisation of the agency, AAC-DEVA explained that this are addressed in the development of its Strategic Plan. ”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	22/06/2020
Standard	3.6 Internal quality assurance and professional conduct
Keywords	Lack of sufficient and consistent IQA processes
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“In its previous decision of inclusion, the Register Committee flagged the effectiveness of AAC-DEVA’s internal quality assurance arrangements. In May 2018, AAC-DEVA established an Internal Quality Assurance Commission to review its own internal quality assurance methodology, but at the time of the site-visit the agency was still reviewing its internal documentation. The panel saw insufficient evidence of a pattern of continuous improvement in the internal quality assurance of AAC-DEVA. While there has been a spur of activity in preparation for the external review the panel did not consider this was sufficient to achieve meaningful results. In its additional representation the agency reasserted its commitment for improving its internal QA system and that it was in the process of reviewing its Services Charter and setting up a web application designed to support continuous improvement and facilitate the management of the agency’s activities. ”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.3 Implementing processes
Keywords	incomplete implementation of reviews for independent private providers
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“In its 2016 decision on QQI's Substantive Change Report, the Register Committee flagged for attention the use of site visits. The Committee noted that site visits are not used in some processes, but that this was adequately explained by a “lighter touch in recognition of the greater responsibility held by those providers” (p. 27). The Register Committee concurred with the panel that the alternative approach used is effective and robust in the light of the process' objectives.The Register Committee noted that QQI has finalised its external quality assurance processes and moved to full implementation of most processes since the last review.The external review report, however, noted that for independent private providers “no cyclical institutional reviews have taken place as a result of the delay in approving those providers’ Quality Assurance Procedures through Re-engagement” (p. 28). While the report cited a combination of reasons for that and underlined that it was not the result of poor intentions on the part of the agency, the report noted that some providers may actually go up to 12 years without an institutional review. The panel further noted that the “risk of concerns about quality going unnoticed in these providers” was partly, but not wholly, mitigated by QQI having more intensive engagement with them through theirprogramme validation relationship (p. 28).In light of the incomplete implementation of reviews for independent private providers the Register Committee was unable to concur with the panel's conclusion of compliance, but considered that QQI only partially complies with the standard.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.4 Peer-review experts
Keywords	Panels composition
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“In its 2016 decision on QQI's Substantive Change Report, the Register Committee flagged for attention the composition of QQI expert panels.The Register Committee noted that some specific QQI processes do not use traditional expert panels, but are based on desk assessments or dialogues by QQI staff, followed by subsequent decisions where applicable. The Committee noted that the decision-making bodies include all perspectives that are otherwise required to be on a panel.The Committee further noted that wherever panels are deployed their composition complies with the standard. The Register Committee therefore concluded that the flag was addressed and concurred with the panel's conclusion that QQI complies with the standard.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.7 Complaints and appeals
Keywords	Scope of the appeals system
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“The Register Committee noted the panel's remark that the outcomes of cyclical institutional reviews can currently not be appealed, while noting thata provider “may still wish to challenge the findings in a way that would be better suited to an appeals process rather than a complaints process” (p. 33).The Register Committee has generally understood the standard to require that all results of external quality assurance processes be open to appeal, hence including reports that do not include “categorical decisions”.The Committee therefore underlined that QQI should consider widening the scope of its appeal system in monitoring the fitness for purpose of the current arrangements, per the panel's remarks. ”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	3.4 Thematic analysis
Keywords	Producing effective thematic analysis reports
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“In its decision of 2015 to admit QQI to the Register, the Register Committee flagged for attention the production of thematic analyses by QQI.The Register Committee understood from the panel's report that QQI has been proactive and effective in producing a range of thematic analysis reports, which are considered useful in the sector for improving quality and quality assurance, even though not having completed full cycles in all external quality assurance activities.The Register Committee therefore considered that the flag has been addressed and concurred with the panel's conclusion that QQI complies withthe standard.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	3.6 Internal quality assurance and professional conduct
Keywords	Efectiveness of internal QA
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“The development of QQI's internal quality assurance system was flagged for attention when QQI was admitted to the Register in 2015.The Register Committee noted that the panel described QQI's internal quality assurance instruments as effective. They cover all its external quality assurance processes and thus respond to the recommendation made in the last external review of QQI.While the panel noted that some future adjustments might be necessary once further external QA processes are rolled out, the Register Committee considered that the flag has clearly been addressed.The Register Committee therefore concurred with the panel's conclusion that QQI complies with the standard.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/03/2020
Standard	2.6 Reporting
Keywords	Publication of full reports for one procedure
Panel conclusion	Full compliance
Clarification request(s)	Panel (14/02/2020)
RC decision	Compliance

“In its previous decision, the Register Committee flagged ACSUG’s publication of full reports of the FIDES-AUDIT reviews. According to the analysis of the review panel, all completed reports by ACSUG are published. The Register Committee could further verify that the results of the FIDES-AUDIT review are made available on the agency’s web page. The review panel’s analysis also revealed that the reports resulting from the ex-ante accreditation (validation) assessment are not published by ACSUG, as deferred applications for initial accreditation are usually withdrawn by the higher education institution before a final decision is taken. The Register Committee has therefore asked the review panel to clarify whether ACSUG has ever reached a final decision of rejection in an ex-ante accreditation assessment and whether in such a scenario, ACSUG would publish its report with a negative decision? In its response letter, the panel clarified that ACSUG has not reached a final decision of rejection in an ex-ante accreditation (validation) assessment at that time. The panel added that it has no reason to doubt that ACSUG would publish its ex-ante reports with a negative decision, in case that such reports were completed. Having considered the clarification by the panel, and the reassurance that ACSUG would publish any negative reports resulting from its ex-ante accreditation, the Register Committee could follow the conclusion of the panel that ACSUG complies with ESG 2.6”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/03/2020
Standard	2.7 Complaints and appeals
Keywords	Lack of an independent appeals committee
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee noted that Galician Committee for Reports, Assessment, Certification and Accreditation (CGIACA) is both the body responsible for evaluation, certification and accreditation and also the body responsible for the appeals following these reviews. In order to ensure a fair decision-making, the panel recommends the establishment of an independent committee to review appeals. In its Additional information to the external review report (p. 4) the agency stated that following the CGIACA’s meeting in late autumn, the agency will consider the possible nomination of candidates for an independent appeals board. The Register Committee welcomed the ACSUG’s intention to set up a separate board to handle appeals, but the Committee underlined that such changes are yet implemented and that the nomination of its members and the revised appeal process is yet to be reviewed. The Register Committee was therefore unable to concur with the review panel’s judgment of (substantial) compliance, and concluded that ACSUG complies only partially with ESG 2.7.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/03/2020
Standard	3.3 Independence
Keywords	Organisational independence: appointments in the majority of the agency’s made by the Galician government
Panel conclusion	Full compliance
Clarification request(s)	Panel (14/02/2020)
RC decision	Partial compliance

“The Register Committee noted that the president of the Governing Board of ACSUG, the director of ACSUG and the president of the CGIACA (following the nomination by the Governing Board) are all members appointed by the Galician Government. In view of the panel’s recommendation to ACSUG i.e. to set procedures in the selection of the director of the agency, president of the Governing Board and president of the CGIACA the Register Committee asked the panel to clarify whether the appointments of these bodies follow a set of criteria and if the panel has reviewed these criteria. The panel responded that it has only considered the criteria and tasks set in the Statutes of 2018, based on professional competence and prior experience, and that these criteria are intended to be used in the future appointment processes. While the Register Committee welcomed the appointment criteria based on professional competence and prior experience, the Committee underlined that the regional Galician Government nevertheless remains directly involved in the appointment of the majority of members in the agency’s governing body, in the appointment of president of the Governing Body, the president of the agency’s decision making body (CGIACA), the director of the agency and the president of the Advisory Council. The Register Committee welcomed ACSUG’s intention of appointing a representative from outside Galicia in the Governing Board and as part of CGIACA’s but noted that the current addition does not change the agencies reliance on the regional Spanish government. While the involvement of the government (as one of its stakeholders) is encouraged, the current organisational arrangements does not guarantee clear and sufficient safeguards to prevent the possible interference of the regional Galician government in ACSUG’s governance. Considering the close interlinkage between ACSUG and the Galician government, the Committee could not follow the panel’s judgment of (full) compliance, and concluded that ACSUG complies only partially with ESG 3.3.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	16/03/2020
Standard	3.4 Thematic analysis
Keywords	Lack of ressources for thematic analysis
Panel conclusion	Partial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The panel’s findings show that ACSUG engages in broader forms of analysis, however these studies do not fully answer the demand for thematic analysis as defined in the ESG. In its Additional information to the external review report, the agency stated that the development of thematic analysis is going to become its priority following the hiring of new staff. ACSUG intends to launch external working groups to develop thematic analysis, which are to be coordinated by the new staff. In addition ACSUG also is considering to develop thematic analysis through their involvement in REACU (the Spanish Network of quality assurance agencies). The Register Committee welcomed ACSUG’s plans of addressing its shortcomings in preparing thematic analysis, but as it currently stands ACSUG does not fully meet the requirement of the standard i.e. no studies have been undertaken yet by its new working group. The Register Committee therefore concurred with the review panel that ACSUG complies only partially with ESG 3.4.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.1 Consideration of internal quality assurance
Keywords	Part 1 reflected in evalag’s criteria
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“When evalag’s registration was last renewed, it was flagged for attention whether all standards of Part 1 of the ESG are consistently addressed in evalag’s accreditations and evaluations.The Register Committee noted the panel’s comprehensive analysis, based on evalag’s SAR and mapping tables, of how Part 1 of the ESG is reflected in the agency’s different sets of criteria. The Committee concluded that the flag has been addressed.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.2 Designing methodologies fit for purpose
Keywords	Involvement of students in developing the international accreditation and evaluation processes.
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The Register Committee noted that the processes and criteria for evalag’s work outside of the German accreditation system are designed by the Foundation Board. Based on the analysis by the review panel the Committee understood that students have little involvement in designing evalag’s own processes and are also not involved in the Foundation Board (see p. 30).The involvement of students in developing the international accreditation and evaluation processes was a recommendation from the previous ESG review of evalag in 2014, but has not yet been addressed.While the Register Committee welcomed evalag’s commitment expressed in its statement on the review report, no changes have been made as yet. The Committee was therefore unable to concur with the panel’s conclusion of substantial compliance, but considered that evalag only partially complies with the standard.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.3 Implementing processes
Keywords	Implementation of follow-up procedures; accreditations carried out without a site visit
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“For accreditation in Germany, the Register Committee underlined that evalag retains responsibility for follow-up to take place, even if GAC makes the accreditation decisions under the new legal framework. This does not exclude that GAC actually implements the follow-up processes, as long as evalag has assured itself that this indeed happens.Given the small number of accreditations under the new legal framework thus far, it was not possible to analyse the actual practice at this point. The Register Committee therefore noted that this is a matter for further attention in future reviews of evalag.While the German legal framework potentially allows for an accreditation procedure to be carried out without a site visit, the panel understood from evalag that the agency did not plan to make use of that option. The Register Committee underlined that it might be helpful if evalag would point that out in its official documentation.Notwithstanding the above remarks, the Register Committee concurred with the panel's conclusion that evalag complies with the standard”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.6 Reporting
Keywords	Publication of negative reports
Panel conclusion	Full compliance
Clarification request(s)	–
RC decision	Compliance

“When evalag’s registration was last renewed it was flagged for attention whether evalag has moved to publish reports where the accreditation decision was negative. The review panel observed that evalag has had no negative decisions so far. The panel nevertheless confirmed that evalag’s clear policy is to publish all reports regardless of the outcome; the panel had no doubts that a negative report will be published. The Register Committee therefore concluded that the flag has been addressed.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	2.7 Complaints and appeals
Keywords	Independence of the appeals committee
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Compliance

“In the previous decision to renew evalag’s registration the Register Committee flagged for attention how evalag has followed up the recommendation to separate the bodies in charge of appeals from the bodies deciding on accreditation, and to rule out parallel memberships.The review panel confirmed the independence of the appeals committee from the evalag decision-making body for accreditation. The panel further reported that parallel memberships are now ruled out. The Register Committee therefore concluded that the flag has been addressed.”

Full decision: see agency register entry

Application	Renewal
Review	Full, coordinated by ENQA
Decision of	05/11/2019
Standard	3.1 Activities, policy and processes for quality assurance
Keywords	Involvement of student in evalag’s governing structure, and overarching strategy
Panel conclusion	Substantial compliance
Clarification request(s)	–
RC decision	Partial compliance

“The review panel found that evalag had no clear overarching strategy, bringing together planning, budgeting and risk assessment. The review panel noted stakeholders are formally involved in evalag’s governance through the Foundation Board, while the Board does not include a student member. Stakeholders are further involved in evalag’s work through participation in workshops and similar activities. The panel recommended that a student be appointed to the Foundation Board.Considering the concerns re. the lack of an overarching strategy and that one important stakeholder group is not represented in evalag’s governing structure, the Register Committee was unable to concur with the panel’s conclusion of substantial compliance, but considered that evalag only partially complies with the standard.”

Full decision: see agency register entry