View Current

Learning Analytics Data Use Policy

This is the current version of this document. You can provide feedback on this document to the document author - refer to the Status and Details on the document's navigation bar.

Section 1 - Purpose of Policy

(1) The purpose of this Policy is to:

  1. assist staff to fulfil their responsibility to take reasonable care in obtaining, storing, processing and distributing data for learning analytics;
  2. provide Guidelines for the management of student privacy and ethical use of data issues that arise within the context of learning analytics at UOW. This includes use of learning analytics data for research purposes; and
  3. establish a best-practice culture of data management for all UOW learning analytics stakeholders.
Top of Page

Section 2 - Application and Scope

(2) The use of learning analytics at UOW forms part of the broader activities undertaken to support students through their studies and reach their full academic potential.

(3) This Policy applies to any person responsible for the preparation, analysis, decisions and actions at UOW arising directly from learning analytics.

(4) The data sources used for learning analytics at UOW cover the key aspects of the UOW learning platform. This includes, but is not limited:

  1. Moodle;
  2. SOLS;
  3. Library (aggregated information only); and
  4. Peer Assisted Study Sessions (PASS).

(5) Data related to student utilisation of counselling services is protected by health records privacy legislation and excluded from use in learning analytics.

(6) While the focus of learning analytics at UOW is on near real-time delivery of learning related information to our staff and students to support the student learning experience, the scope of this Policy includes the continuous improvement of teaching and learning. This includes academic or professional services staff engaged in research activities associated with the University.

(7) The scope of this Policy includes all related activities within the information management lifecycle of learning analytics data as follows:

  1. integration;
  2. analysis;
  3. dissemination;
  4. maintenance.

(8) The primary focus of learning analytics is for onshore UOW students.

Top of Page

Section 3 - Policy Principles

(9) The overarching principles of this Policy are based on a literature review of the ethical and legal issues associated with learning analytics.

  1. responsibility. The Deputy Vice-Chancellor and Vice-President (Academic and Student Life) (DVCA) has overall responsibility for the legal, ethical and effective use of learning analytics;
  2. transparency. Clear explanations will be given to staff and students at UOW around data sources, analytics purposes and usage practices associated with learning analytics at UOW;
  3. informed consent. The general consent obtained by students on enrolment covers the application of learning analytics at UOW. The duty of care obligations towards students means UOW will not permit students to opt out of learning analytics initiatives;
  4. privacy. Access to student data and analytics should be restricted to those identified by UOW as having a legitimate need to view the data;
  5. validity. Data and analytic process will be monitored to develop and maintain confidence in learning analytics at UOW;
  6. access. Students at UOW should be able to access all their own personal data informing their learning analytics in an accessible format;
  7. enabling positive interventions. Interventions arising from learning analytics are designed to maximise the possibility of making a positive impact for students;
  8. minimising adverse impacts. Learning analytics will not give a complete picture of an individual student’s learning. Steps will be taken by UOW to ensure outputs of learning analytics do not bias staff, students or institutional perceptions and behaviours towards either staff or students; and
  9. stewardship of data. Data for learning analytics will comply with existing UOW policies. Any use of learning analytics data at UOW must be approved by the DVCA.
Top of Page

Section 4 - Transparency in Learning Analytics Activities

(10) The University is committed to operating the learning analytics initiatives in a manner, as open and transparent as possible.

(11) Duty of care obligations for students requires the University to use learning analytics to monitor student progress towards learning goals. A student is unable to opt-out of inclusion in learning analytics initiatives at the University because of this duty of care obligation.

(12) All students must be made aware of learning analytics activities at the University through multiple touch-points, including but not limited to:

  1. a statement regarding the operation of learning analytics in every subject outline;
  2. UOW public webpage explaining learning analytics and the objective to support learning at UOW;
  3. a clear statement on every Moodle site where an academic chooses to use learning analytics, with a link to the page mentioned in clause 3.

(13) The data sources, the purposes of the analytics, the metrics used, who has access to the analytics, the boundaries around usage, and how to interpret the data must be explained clearly to staff and students using the touch-points outlined in clause 12.

(14) The University must clearly describe the processes involved in producing the analytics to students and staff. This will be done using different channels such as the touch-points outlined in clause 12.

Top of Page

Section 5 - Student Access to Learning Analytics

(15) Student access to learning analytics is under the following conditions:

  1. direct access to analytics designed specifically for students;
  2. indirect access granted by academic staff for information about individual students. This could include course-level information as well as subject-level information. The decision to share such information is at the discretion of the individual academic and needs to be mindful of the potentially harmful impact on the student’s academic progress or wellbeing; and
  3. students will be shown the raw data about them used for both student-facing and teacher-facing learning analytics if they ask to see it.

(16) Students have a right to be able to correct inaccurate personal data held about themselves.

Top of Page

Section 6 - Student Privacy

(17) The use of learning analytics data at UOW is underpinned by a Privacy Impact Assessment (PIA) undertaken in accordance with the best practice available in higher education sectors worldwide.

(18) Access to student data and analytics is restricted to those staff identified by the institution as having a legitimate need to view the data. This includes, but is not limited to the following:

  1. Relevant academic staff:
    1. Subject Coordinators
    2. Heads of Students
    3. Course Directors
    4. Executive Deans
    5. Associate Deans Education
  2. Relevant professional services staff:
    1. Data and Analytics Division (DnA) staff
    2. Deputy Vice-Chancellor and Vice-President (Academic and Student Life) staff
    3. Learning, Teaching and Curriculum (LTC) staff

(19) Access to the data contained within the learning analytics data warehouse must be managed to protect student privacy:

  1. staff may only gain access to the learning analytics data warehouse with the approval of the DVCA for the following purposes:
    1. business as usual recipient of learning analytics deliverables; and
    2. approved research-based learning analytics activities conforming to the elements outlined in section 11 below.

(20) Staff requesting access to the Learning Analytics data warehouse must also have the approval for access to the DASH student information and student equity sensitive data. This serves as a co-requisite with requirements outlined above in clause 19.

(21) All applications for access to the learning analytics data warehouse must include:

  1. clear descriptions of the data elements being requested;
  2. clear descriptions of the intended purpose of access;
  3. start and finish dates for access to the data; and
  4. clear proposals for action to be taken if any learning analytics indicators flag individual ‘at risk’ students. These actions must be consistent with the Guidelines for Actioning Learning Analytics Insights as approved by the Learning Analytics Advisory Group;

(22) Access to the learning analytics data warehouse will only be provided for purposes allowed within ethical and legal constraints, with evidence of any required approvals.

(23) The conditions required for information to be disclosed outside UOW are outlined in the ‘Disclosure of Information’ section of the Privacy Policy.

(24) Use of learning analytics data for academic promotion purposes must not contain personally identifiable student information.

Top of Page

Section 7 - Validity of Data and Analytics Processes

(25) In order to develop and maintain confidence in learning analytics and ensure it is used to the benefit of students, the University will monitor the quality, robustness and validity of the learning analytics data and processes.

(26) The University will take measures to ensure that:

  1. inaccuracies in the data sources for learning analytics are understood and minimised;
  2. the implications of incomplete learning analytics datasets are understood;
  3. the optimum range of data sources for learning analytics purposes are selected; and
  4. misleading correlations on learning analytics are avoided.

(27) All algorithms and metrics used for predictive analytics or interventions will be understood, validated, reviewed and improved by appropriately qualified staff.

Top of Page

Section 8 - Enabling Positive Student Interventions

(28) The circumstances when analytics suggest that a student could benefit from additional support, along with the type and nature of interventions, are specified in the Guidelines for Actioning Learning Analytics Insights.

(29) The University will record predictions and interventions made based on insights generated through learning analytics processes. This information will be auditable so the appropriateness and effectiveness of both predications and interventions is available for review.

Top of Page

Section 9 - Minimising Adverse Impacts

(30) The University recognises that analytics cannot give a complete picture of an individual’s learning. The University is thus required to take into account personal circumstances when deciding the actions to take on insights generated through learning analytics.

(31) Opportunities for students to unethically influence the learning analytics will be minimised. This includes preventative actions such as rigorous designs in the source transactional systems. It also includes contingent actions such as robust auditing and careful interpretation of the data.

Top of Page

Section 10 - Continuous Improvement of Teaching and Learning Activities

(32) Data analysis focussed on the continuous improvement of teaching and learning activities is undertaken with the support of the DVCA. This support is contingent upon the results of such data analysis not being published, unless express permission has been granted by UOW as per the elements outlined in section 11.

Top of Page

Section 11 - University Research

(33) Research conducted by the University using learning analytics data is subject to existing research policies at the University.

(34) The approval process is covered in Appendix A: Approval Process – University Research Using Analytics Data and includes:

  1. written approval from the DVCA; and
  2. written approval from the Human Research Ethics Committee (HREC)
Top of Page

Section 12 - Consequences of Breaching this Policy

(35) The University views any breach of this Policy as extremely serious. Depending on the severity of the breach, a staff member or student may face disciplinary action in accordance with the Academic Misconduct (Coursework) Procedure, Academic Integrity Policy, University Code of Conduct and Professional Staff Misconduct Guidelines.

Top of Page

Section 13 - Roles and Responsibilities

Staff

(36) Staff have a responsibility to:

  1. act on the insights identified through learning analytics as appropriate to their role;
  2. record details of the interventions triggered by learning analytics;
  3. comply with UOW learning analytics practices as specified in this Policy and associated procedures, guidelines and supporting documents;
  4. comply with the data management policy documents and Records Management Policy when handling data in learning analytics reports;
  5. comply with the Privacy Policy when handling personal information within the learning analytics data; and
  6. comply with research policy documents if undertaking research using learning analytics data.

Students

(37) Students have a responsibility to:

  1. act on any learning analytics presented to them. These obligations will be clearly set out and communicated by UOW to students;
  2. not engage in any opportunities to unethically influence the learning analytics;
  3. notify UOW staff if they would like access to their data used for learning analytics purposes; and
  4. notify UOW staff of any corrections required to inaccurate personal data held about them.

Pro Vice-Chancellor (Students) Staff

(38) Deputy Vice-Chancellor and Vice-President (Academic and Student Life) staff have a responsibility to:

  1. develop and review student intervention Policies and associated Procedures and Standards;
  2. serve as an intermediary to support services as part of enacted student interventions;
  3. record details of the interventions triggered by learning analytics;
  4. provide advice on learning analytics practices and issues to business units across UOW; and
  5. contribute to learning analytics training and education programs.

Learning, Teaching and Curriculum (LTC) Staff

(39) LTC staff have a responsibility to:

  1. implement and support a culture of learning analytics informed educational practice;
  2. design, develop, implement and support analytics processes to be performed on the data;
  3. provide advice on learning analytics practices and issues to business units across UOW; and
  4. provide learning analytics training and education programs.

Data and Analytics Division (DnA) Staff

(40) Data and Analytics Division staff have a responsibility to coordinate and maintain UOW’s Enterprise Data Warehouse, including:

  1. collection and integration of data to be used for learning analytics into the data warehouse; and
  2. design and develop the technical infrastructure underpinning learning analytics reports and analysis.

Learning Analytics Advisory Group

(41) The Learning Analytics Advisory Group has a responsibility to:

  1. consider the impact of student interventions, training requirements and workload on staff roles; and
  2. provide clear direction about the priority given to learning analytics in relation to other UOW requirements.

Ethical Use of Data Advisory Group

(42) The Ethical Use of Data Advisory Group is considered the main forum for consultation with staff and students on this policy.

Top of Page

Section 14 - Appendix A: Approval Process – University Research Using Learning Analytics Data

(43) Refer to ‘Code of Practice for Learning Analytics’.

Top of Page

Section 15 - Definitions

Word/Term Definition (with examples if required)
Academic staff Staff employed under the Academic Staff Enterprise Agreement.
At-risk student A student with a personalised data-profile which includes evidence informed risk factors that can inhibit successful completion of studies.
DASH Data and Analytics Self Service Hub. The UOW enterprise business intelligence platform.
Data mining Extracting or mining knowledge from large amounts of data.
Data warehouse A data warehouse is a subject-oriented, integrated, time-variant and non-volatile collection of data in support of management’s decision making process.
DVCA Deputy Vice-Chancellor and Vice-President (Academic and Student Life)
HREC Human Research Ethics Committee
Data and Analytics Division Data and Analytics Division. A single unit within Information Management and Technology Services (IMTS).
Learning analytics The measurement, collection, analysis and reporting of data about students and their learning contexts.
Learning analytics data The aggregated dataset sourced from smaller datasets many of which originate in the numerous transaction processing systems in use at UOW.
Learning Analytics Advisory Group A group established by the Deputy Vice-Chancellor and Vice-President (Academic and Student Life) with responsibility for reviewing and advising on the strategic direction and on operational matters at UOW regarding the deployment of learning analytics to support student learning.
Professional Services staff Staff employed under the General Staff Enterprise Agreement.
Staff All persons appointed by the University as academic or professional services staff .