2.10 Faculty and Department Performance Audit (IDPA)

1. The Department Performance Audit (DPA) provides an opportunity for the department, faculty and University to evaluate the effectiveness of a department’s management, learning, teaching and enhancement and quality assurance procedures and monitoring of performance against relevant KPIs and for the University to assure itself and be able to demonstrate to external bodies (QAA) that management of quality and standards which are the responsibility of the University as a whole are being delivered successfully.

 
2. An Audit Team, reporting to Academic Board will, on behalf of the University, audit departments on a 5-6 year rotating basis, to examine that all relevant processes and mechanisms for quality and standards are in place, operating effectively and efficiently, and that recommended enhancements to teaching and learning are being implemented.  Any collaborative provision will be included as part of the quality audit.

 
3. Student representatives from the department should be encouraged to participate fully in the department’s preparations for the audit and in completing the self-evaluation document (SED). Alternatively, student representatives may submit their own self-evaluation document, or alternatively attach an appendix to the department submission.

 

Details of the IDPA process
4. The focus of a visit will be clearly specified to a department in advance but will relate to the delivery of all of the department’s provision. When an Audit Team visits the following areas will be considered in the review:

(i) Undergraduate and postgraduate schemes and modules; postgraduate research provision; collaborative provision;

(ii) Feedback Systems;

(iii) Compliance;

(iv) Staff Development and Training.

 
An audit visit will typically last one or two days and involve the following aspects:

(i) Inspection of a self-evaluation document, relevant committee minutes and all other documentation concerned with teaching and learning in a department;

(ii) Meeting(s) with Head of Department and staff with responsibility for different aspects of teaching and learning (e.g. examinations, student support, admissions);

(iii) Meeting(s) with student representatives, undergraduate, taught postgraduate and research postgraduates;

(iv) Meeting(s) with other staff involved in quality assurance and/or teaching and learning (e.g. new staff members / administrators);

 

 

Audit Team Membership and Indicative Schedule
6. Membership of the Audit Team will be discussed with the Chair of Academic Board and/or Academic Registrar. Normally an Audit Team will include the following members:

(i) Chair (normally the Pro Vice-Chancellor Learning and Teaching);

(ii) A Faculty Associate Dean;

(iii) Head of Department from a department scheduled for audit in the near future;

(iv) External Academic Assessor (Academic Subject expert and if appropriate an industry expert);

(v) Academic Registrar or their representative;

(vi) Student representative;

(vi) A member of Academic Registry staff will serve as Secretary to the Audit Team, overseeing the exercise and drafting the report.

 
7. No more than two members of the University Executive should normally be members of a Departmental Audit Team.  Audits will normally be chaired by the Pro Vice-ChancellorLearning and Teaching. The internal auditors for each visit will be identified by the Academic Registry. All members of staff appointed to serve as members of Audit Teams will be given appropriate training and guidance, and the External Assessor will be issued with formal notes of guidance.

 
8. Departments will be invited to nominate three professional colleagues from the United Kingdom who could act as an External Assessor for which a fee and expenses are paid.  An External Assessor should not be a current External Examiner from within the department and should preferably have knowledge of quality assurance processes and procedures.  The choice of external assessor will be made by the Chair and the Secretary of the Audit Team in consultation with the department.

 

Indicative Schedule
9. The following is an indicative schedule for a one-day audit (Departmental or Faculty). The Chair and Secretary may meet with students ahead of the main event, and submit a written summary of the discussion for consideration by the full audit team:

No

Time

Event

1

9.15 am

Private meeting of Audit Team members

2

10.00 am

Meeting with the Head of Department

3

11.00 am

Private meeting of Audit Team members

4

11.30 am

Meeting with senior academic staff with key roles in the department (It may be appropriate to see two separate groups)

5

12.30 pm

LUNCH

6

1.30 pm

Private Meeting of Audit Team

7

2.00 pm

Meeting with students*

8

2.45 pm

Private meeting of Audit Team members

9

3.15pm

Meeting with other staff including administrative and part time staff involved with quality assurance and/or teaching and learning

10

4.15 pm

Private meeting of Audit Team members

11

4.45 pm

Feedback to Head of Department

12

5.00 pm

Finish

*Where appropriate the Chair and Audit Secretary may meet with students ahead of the Panel.

 

Details of the process

10. The focus of a visit will relate to all schemes (from Foundation and undergraduate degrees to taught postgraduate Master’s schemes, and Postgraduate Research). The following items will be included in the review:

 
Undergraduate and Postgraduate Schemes and Modules

(i) the standards of teaching and learning in modules.

(ii) Methods of assessment in their relationship to:

  • learning outcomes
  • course content
  • learning strategies
  • transferable skills

(iii) Student Progression and Achievement

(iv) Student Support and Guidelines

(v) Student representation

(vi) Teaching and Learning Resources

(vii) Progression between different levels of undergraduate courses (Level 0 through to level M in the case of Integrated Masters schemes), and the relationship between undergraduate and postgraduate modules.

(viii) Holistic nature of the course (including Joint Honours).

(ix) Teaching and learning innovations e.g. VLE

(x) Student Handbooks and other information provided to students

(xi) Any Franchising, collaborative or Distance Learning schemes

(xii) Welsh Medium teaching (if applicable)

(xiii) Placements or work experience (if applicable)

(xiv) Exchange and Erasmus

(xv) Support, training, supervision and monitoring of research students.

 

Feedback Systems:

(i) External Examiners’ Reports

(ii) Feedback from Professional, Statutory and Regulatory Bodies (if applicable)

(iii) Student Module and Scheme Evaluations, reports on MEQs, Tell us Now

(iv) Annual Monitoring of Taught Schemes

(v) KPIs including National Student Survey Results

 

Compliance:
The Audit Team will also ensure that departments are complying with the University’s Regulations and the Academic Quality Handbook, and engaging with and implementing University policy, including, for example, the University’s Learning and Teaching Strategy.

 

Staff Development and Training:
The Audit Team will discuss the following issues with departments:

(i) University and Departmental induction and training, and the development of staff.

(ii) Peer Observation process.

 

Documentation

11. Departments will be expected to evaluate themselves against a set of statements in relation to quality and standards of teaching and learning, using the SED template which will include KPIs. The statements cover the following areas: academic schemes, teaching and learning, assessment and feedback, research students, student participation and experience, academic staff development, collaborative provision and external examiners.

 
12. The comments section should be used to reference supporting evidence and identify action points for quality enhancement and indicate the steps the department has identified that it needs to take to enhance quality and/or improve performance.

 
13. In addition, the department is asked to write a commentary (no more than two sides of A4) reflecting on the major strengths, weaknesses, opportunities and threats it has identified (SWOT analysis). The scores and comments will be used as a basis for discussion during the audit.

 
14. The department should provide the following documentation which should be uploaded onto the Academic Registry SharePoint site no later than three weeks before the audit visit:


(i) Departmental Structure Roles and Responsibilities: Details of the composition and responsibilities of the department.

(ii) Departmental Committee Minutes for the previous twelve months.

(iii) Strategy Documents  for example:

Teaching & Learning Strategy

NSS Action Plan

Employability Strategy

TELG Action Plan

(iv) Reports on Periodic Quality Assurance Processes:

  • Period Scheme Review report(s)– report of most recent review
  • Annual Monitoring of Taught Schemes (AMTS1 forms) documentation for the previous year.
  • The most recent report of a professional body or external organisation (where relevant) on schemes offered by the department.
  • Evidence of student feedback on modules and any actions taken from the previous and current (if applicable) academic year.

(v) Departmental Publications:

  • Department or Faculty Welcome Week or induction programme.
  • Department student handbooks for the current academic year
  • Staff Handbook(s)/guidance

(vi) Any other documentation which may be relevant.

 

The Academic Registry and the Planning Department will also provide the following on the SharePoint site:

(i) External Examiners’ Reports for the previous three academic sessions.

(ii) Previous DPA Report and Progress Report.

(iii) Annual Departmental Review Report prepared by the Planning Department including statistical data relating to applicants, students and staff.

(iv) Key Information Sets.

(v) Documentation at Faculty level.

The audit team may request additional evidence after the meeting if specific issues need to be explored further.

 

Outcome of the Departmental Performance Audit visit

15. The Chair and Secretary may invite the External Assessor to submit a written report for consideration by the Audit Team during the DPA event. The Academic Registry will also liaise with the External Assessor and provide information on University level QA processes as appropriate.

 
16. Following the audit, a report will be produced which will highlight areas of good practice and identify recommendations for the department, for the faculty and for the University. This report will be considered by Academic Board. The Head of Department will be given an opportunity to comment on factual accuracy of the draft report. The department will not be expected to respond in full with an Action Plan until a later date.

 
17. The department will be asked to submit an Action Plan within three months of the publication of the report, indicating how it intends to implement the recommendations of the Audit Team. A template for the Action Plan will be provided with the report.

 
18. The department will be required to provide a written follow up to the report within 12 months of the audit, indicating how it is implementing the recommendations identified in the Action Plan. Where a specific issue gives cause for concern the department may be required to respond to this within a shorter period. The written response will be considered by Academic Board.

 
19. If, as a consequence of the written response, Academic Board is not satisfied with the progress or implementation of the action points, it can request the following:

(i) A visit to the department to discuss the action points in more detail by the Chair and Secretary of the Audit Team.

(ii) That a follow up internal audit be conducted within the department between 12 and 36 months.