ºÚÁÏÍø

1. This document sets out the University's procedures related to learning analytics, related uses, and responses to data and analytic outcomes.

1. The Procedures apply to all students enrolled in coursework courses at the University of Canberra (UC) and at the University of Canberra College (UCC), academic staff teaching them (including professional and executive staff who oversee students’ learning and the teaching teams), at the University.
2. Relevant policy to support higher degree by research students is set out in the Higher Degree by Research Academic Progress Policy. Students enrolled at the University of Canberra English Language Centre (UCELC) are covered by policy set out in UCELC’s ELICOS Student Management Policies.
3. Information about data security and privacy is covered in the DITM and Records Management Policy Manual and the Privacy Policy.
4. Information relating to significant and continued lack of engagement or poor academic progress (which may lead to conditions placed on a students’ enrolment) are covered in the Academic Progress Procedure for Coursework Students.

Introduction

1. In describing the management of processes, these Procedures give guidance on how to make use of Learning Analytics displayed on digital dashboards tailored to the context of learning and teaching and describe the way that learning analytics are used to improve the provision of education and learning experiences for students.
2. Furthermore, these Procedures support an evidence-based (non-deterministic) approach to interpreting static and dynamic information gathered from various University data-sets.
3. These procedures also describe the University’s data management processes as applied to the purposeful creation of learning analytics, being:

"the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs."[1]

Purpose of data and definition of risk

4. These procedures outline the University’s processes in supporting students through early identification of need for intervention, by assessment of risk.
5. The University monitors, records and assesses the academic progress of students in the course/units in which they are enrolled.
6. Progress is measured through learner analytic tools, which collate relevant information of a student’s attendance and engagement in a course and assign students to risk categories by unit.
7. The learner analytic software considers numerous variables collated on individual students and responds to key indicators that can contribute to a student being considered at-risk of academic failure.
8. The University defines risk of academic failure as continued lack of engagement in the course and/or poor academic progress, and/or external/welfare concerns that could lead to at least one of these factors:
   1. actions by the student that increase their likelihood of failing one or more units, including low rates of participation whether face-to-face or online;
   2. late or non-submission of assessment tasks; and
   3. poor performance in assessment tasks.
9. Information on student risk indicators from learner analytics appear in the unit/course/discipline head convener dashboards from week three of each teaching period, to allow suitable support to be offered to students in a timely manner.
10. At any time, academic staff who become aware of students at-risk of not making satisfactory progress within their unit (e.g., through learning analytics reports, participation, completion of assessment tasks, or any other means) should advise students of the academic and personal support services available at the University.

Collection of data

11. Learning analytics at the University are derived from data collected from a variety of sources, which are retrieved from, or subsequently stored within a dedicated data warehouse.
12. The collected data is drawn from the University's student management system and learning management platform.
13. The collected data is visualised through a dashboard designed to promote learner and teacher engagement in educational partnerships.

Use of data

14. The University applies learning analytics to facilitate the creation of adaptive and responsive educational design and learning environments, in addition to other sources of information about students’ academic progress (such as faculty records, and central University marks and grades).
15. Learning analytics support the identification of students who may be at-risk of not making satisfactory academic progress through:
    1. Engagement measures, calculated through extracting information from students’ use of learning resources, learning activities and other elements which are included in the University online learning environments.
    2. Risk of academic failure determined through several measures which are weighted according to various factors relating to academic progress and engagement. Risk is categorised by high, medium and low risk of academic failure.
    3. Progress measures in the dashboard, calculated based on actual completed credits, as well as predictions of academic risk (incorporating engagement).
16. The University responds to engagement, risk and progress indicators in a timely and appropriate manner. That data provides:
    • students with an overview of their engagement and progress in the units in which they are enrolled, and with their overall progress in regard to course completion.
    • academic staff with information on how students in their units are progressing in relation to engaging with online materials, assessment tasks and completion rates.
    • the University’s executive with comparative data on retention, engagement, risk and progress, and monitors the overall progress and achievement of learners across the University.
17. An annual report will be submitted to UEC, by Learning and Teaching during Semester 1 to detail the overall data for the previous academic year for UC students, in relation to numbers of students at-risk, engagement measures, statistical data for demographic and associated retention/attrition rates, as well as related data derived from the learning analytics platforms.

Monitoring of data

18. A dashboard provides students with data and prompts them to increase their engagement in their units, meet assessment deadlines and gives them details of their overall course progress, marked and confirmed grades and enrolled units. This empowers students to self-track and monitor their own engagement, achievement and progress in their units.
19. Collated data is accessible by discipline heads/program directors, course conveners and unit conveners at the specific levels for which they are responsible. All staff are responsible for regularly reviewing this data and responding, in a timely fashion, to any issues of concern or requirements for additional support needed by students.
20. Dashboards enable unit conveners to engage with their students, respond to feedback provided by students, and review their students ‘at-risk’ and ‘engagement’ with their learning materials, activities and assessments.
21. Course conveners, discipline heads/program directors and Associate Deans Education (ADEs) must ensure that their staff regularly review the data provided in their dashboards, and are responding to them, with the primary goal of responding to student academic needs, increasing engagement and improving the student experience.
22. The dashboards provide all executives with data, which includes: total student numbers defined by risk category, satisfaction, and demographics, by faculty, discipline, course and unit. Executives should monitor these reports to determine if there are any significant concerns that may require issues to be addressed.
23. Intervention will occur at any point where a student is defined, whether through learner analytics or other means, as being at risk of non-satisfactory academic progress. Other means may include consideration of academic, welfare, social/personal factors.
24. Staff in teaching teams are likely to be the first staff to be aware of students requiring additional support, however, other staff may be made aware of a student having difficulties in their studies where they may require intervention. Students should be provided with advice on the support services available.
25. In instances where intervention is required, the unit convener in the first instance should be contacted once a student has been identified as being at risk of non-satisfactory academic progress.
26. It is also recommended that staff continue to encourage students who are in the low-risk cohorts, and congratulate cohorts on their achievements.

Privacy

27. Comments submitted by students in their dashboard will be displayed pseudonymously in the unit convener dashboard. Where comments raise concerns for student safety, or may be considered to breach expected language and respect at the University, these will be removed from the dashboard and subsequently submitted with the student identifier to senior staff to allow the student to be contacted as necessary.
28. Overall analysis of students’ satisfaction comments, extracted via the dashboards, will not include student names, numbers, or other identifying information.
29. The executive level dashboard will display student identifiers to allow senior staff to contact students, when necessary, to improve their educational experiences.

 

Who	Responsibility
Students	Seek assistance and provide relevant information to the University to allow their needs to be supported. Check and respond to their University email frequently and should be aware of their administrative responsibilities (as detailed in the , Email Policy, unit outlines and other course material as provided). Participate actively and positively in the teaching-learning process and comply with the requirements of their course or unit of study. Monitor learning analytics to self-track academic achievement and course progress. Respond to learning analytics to adapt engagement activities and adjust study habits. Provide teaching staff with constructive and actionable feedback on the student experience.
Learning and Teaching	Oversee the incorporation and ongoing improvement of learning analytics systems. Monitor learning analytics to ensure system-level feedback is identified and responded to appropriately. Provide staff training and development opportunities in monitoring and responding to learning analytics. Monitor learning analytics to inform the DVCA of features that indicate strengths and weaknesses in the university’s learning environment. Assist staff to employ learning analytics to inform recognition and advancement strategies associated with teaching excellence. Provide learning and scholarly information and resources related to learning support, access to learning resources and materials to University staff (and partner staff where relevant). Produce annual reports (from learner analytic summaries), as defined in these procedures, (or by teaching period if required) to give an overview of the summarised data and report on key trends or areas of concern, as outlined in this document. Provide ongoing staff development and training to academic staff in relation to learner support and the intervention strategy. Ensure that staff receiving analytic reports are aware of their obligations to refer students to the relevant support services, and can interpret data and reports.
Unit Conveners	Target support for those who need it and refer students to the relevant support services in a timely way. Engage with Learning and Teaching training and information on the interpretation of learner analytics reports and active support of students’ learning. Monitor learning analytics to support students’ academic achievement and course progress. Respond to learning analytics to support students to adapt engagement activities and adjust study habits. Implement intervention strategies that address possible risk factors identified via learning analytics and promote student success. Activate a dynamic learning environment that is responsive to student feedback, evidence-based and reflective. Employ learning analytics to prompt and evaluate continuous improvement of the quality of teaching and inform professional development.
University of Canberra College	Identify students at risk of not making satisfactory progress as defined in this policy. Advise the unit convener/course convener, for action as required.
Program Directors / Course Conveners	Provide course-level advice and ensure that there are appropriate communications within course materials/background information to inform students of support services available at the University. Monitor course level aggregated learning analytics including summary data of student risk categories, and take action as required. Monitor learning analytics for all units in the program to gain an overall understanding of the student experience. Ensure teaching staff in the program to respond effectively to learning analytics information. Employ learning analytics to assist with course design and coherence. Monitor learning analytics to quality assure (benchmark and moderate) unit and course level outcomes. Monitor learning analytics to compile reports using comparative internal and external datasets (e.g. QILT).
Associate Deans (Education)	Monitor executive level aggregated learning analytics including summary data of student risk categories, and take action as required.
Faculty Supervisors	Employ learning analytics and teaching staff responses to learning analytics to inform professional discussions and performance reviews.
Executive Staff	Monitor learning analytics to generate university-wide improvements that strengthen teaching and partnerships. Monitor learning analytics to improve system level processes and procedures that impact upon the student experience. Monitor learning analytics to address key performance indicators relating to engagement (risk) and retention (success).
Information Technology Management	Support the integration of InterFace with the virtual learning environment and administration systems. Undertake testing of integrations and new components of the dashboards and enhancements. Report to the Pro-Vice Chancellor Education on status of InterFace system developments. Respond to stakeholder requests for fixes/enhancements - gathering requirements for InterFace developments.
Vice President of Operations	Notify staff of the University’s obligations under ESOS. Ensure that systems are able to accurately capture data on student results to allow for input into the learner analytic software.

Governing framework or legislation

This document outlines the University of Canberra’s policy and procedures to support the academic progress of all students and comply with relevant sections of the (the National Code 2007) established under the (the ESOS Act 2000). It follows the and the .

Commonwealth and Territory governing framework and legislation
·               1989 (ACT)
·               2000
·              
·              

University statutes and rules
·              
·              
·              
University policy and procedures
·               DITM and Records Management Policy Manual
·               Privacy Policy
·              

Related Documents
·               Academic Progress Policy
·               Academic Progress Procedures
·               Disability Policy
·               Mental Health Support Policy
·               Mental Health Guidelines

For more information on the International Student Support Service, please refer to the website:

Abbreviation or Term	Meaning
Learning analytics	"the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs."[1]   [1] Definition from the Learning Analytics and Knowledge conference, 2011
Data	Any quantitative or qualitative data either provided to the University by students or derived from internal data sources, this may include data derived and analysed from multiple sources.