Online Teaching: Evaluating and Improving Courses

Syllabus

• Week 1

  Introduction to the course

  • Welcome to the course

    In this activity, you'll meet the educators, find out what's involved in studying this course and gain an overview of several ways of teaching at a distance.

  • About the course

    Find out about what’s in the course, how you’ll learn and what the assessment involves.

  • Introduction to educational evaluation

    In this activity you'll gain an overview of what's involved in evaluation, the different types of evaluation that can be used in educational settings, and the affordances and challenges of evaluating online teaching and learning.

  • Week 1 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 2

  Planning an evaluation

  • First steps in planning an evaluation

    In this activity you'll consider the first steps in planning an online teaching evaluation, including determining a focus for the evaluation, writing evaluation questions and identifying risks.

  • Developing a logic model

    In this activity you'll look at how a logic model can inform an evaluation and what building one involves.

  • Evaluation questions, indicators and standards

    In this activity you'll consider how to develop evaluation questions on this basis of your logic model, how to identify indicators to be the basis for answering those questions, and the value of standards.

  • Week 2 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 3

  Involving people in an evaluation

  • Considering stakeholders

    In this activity, you'll consider the role of stakeholders in evaluation. You'll explore ways of categorising stakeholders according to their power and interest and will conduct a stakeholder analysis for your planned evaluation.

  • The importance of context

    Consider the importance of the contextual factors that can affect teaching and learning and how using a framework can be useful when conducting an evaluation.

  • Equitable evaluation

    In this activity, you'll look at how to make an evaluation equitable for all involved.

  • Getting ready for an evaluation

    In this activity, you will look at some of the tasks you will need to do in advance of commencing an evauation and will begin developing a draft of the evaluation plan you need to submit for Part 2 of your assessment.

  • Week 3 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 4

  Ethical evaluation

  • Introduction to ethical evaluation

    In this activity, you'll be introduced to the topic of ethics, and will gain an overview of some of the ethical considerations that will need to be managed in an evaluation study.

  • Ethics and evaluating online teaching

    In this activity, you will look at some of the ethical considerations arising for evaluations focused on online teaching, and how they might be managed.

  • The ethical evaluator

    In this activity, you'll consider how the ethical implications of a researchers' subjectivity can be addressed through the adoption of a reflexive approach and how power relations between study participants can be managed.

  • Week 4 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 5

  Theories, frameworks and models

  • Literature and theory

    In this activity, you'll look at ways in which existing literature and theory can inform the design and interpretation of an evaluation. You'll also look at some theories relevant to online teaching.

  • Theories of learning

    In this activity you'll explore some of the learning theories that are relevant to evaluating online teaching.

  • Evaluation frameworks and models

    In this activity, you'll find out about how evaluation frameworks and models can be the basis for a systematic approach to evaluation, and which models and frameworks are particularly suitable for evaluating online teaching.

  • Impact evaluation and theory of Change

    In this activity, you will gain an overview of impact evaluation, find out how a theory of change can be used as the basis for educational evaluation, and what building a theory of change involves.

  • Week 5 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 6

  Preparing for your assessment

  • Reviewing the assessment tasks

    In this activity, you'll look in detail at the five parts of your final assessment and the criteria against which your work will be assessed.

  • Week 6 review

    In this activity, you'll prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 7

  Data collection: Quantitative methods

  • Data collection considerations

    In this activity, you will explore some of the choices that should be considered when designing the data collection strategy for an evaluation study.

  • About quantitative research

    In this activity, you'll find out more about quantitative research. You'll look at the difference between descriptive and inferential statistics and will consider the importance of reliability and validity.

  • Using surveys

    In this activity, you will learn about the ways in which surveys can be used for evaluation studies, and how to design them to ensure they measure what you hope they will.

  • Other types of quantitative data

    In this activity you'll look at existing sources of quantitative data that can support an evaluation, including learning analytics and institutional data on student performance and satisfaction.

  • Week 7 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 8

  Data collection: Qualitative methods

  • About qualitative methodology

    In this activity, you will find out about the key characteristics of qualitative methodology and the types of evaluation questions that can best be answered through a qualitative approach.

  • Case study research and ethnography

    In this activity you will explore the use of two approaches commonly used in evaluation research: case study research and ethnography. You'll consider their key features and whether they could be used in your planned evaluation.

  • Interviewing

    In this activity, you will explore one of the most commonly used qualitative methods: interviewing. You'll learn how to write effective interview questions that will collect relevant data, and how to conduct the interview itself.

  • Other qualitative methods

    In this activity, you will explore additional qualitative data collection methods that can be used for an evaluation: teaching observations, evidence cafes and focus groups.

  • Week 8 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 9

  Data collection: Mixed methods, action research and more planning

  • Mixed methods approaches

    In this activity, you'll explore the benefits of mixing qualitative and quantitative methods within an evaluation study. You'll also consider the different ways in which a mixed methods study might be designed.

  • Action research: Involving educators

    In this activity, you will explore how an action research approach can be used for individual evaluation studies, and as part of larger scale evaluations.

  • Data collection planning

    In this activity, you will develop a measurement framework and draft an initial evaluation plan.

  • Acting on your evaluation findings

    How you can act upon the findings of your evaluation

  • Week 9 review

    In this activity, you'll assess your learning with a short quiz and reflect on your study of this week's material. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 10

  Making your data meaningful

  • Introduction to data analysis

    In this activity you'll consider the decisions you need to make before starting work on your data analysis.

  • Quantitative approaches

    In this activity you'll look at ways of analysing and presenting your numerical data, with an emphasis on the use of descriptive statistics.

  • Qualitative approaches

    Different approaches to data analysis, including an introduction to data transcription.

  • Week 10 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 11

  Disseminating evaluation findings

  • Introduction to dissemination

    In this activity you'll explore why sharing the results of an evaluation is important, and how to plan a strategy for disseminating evaluation findings.

  • Dissemination formats

    In this activity you'll look at a range of dissemination formats, from infographics to formal reports, and will consider their strengths and weaknesses and how they may meet different stakeholders' needs.

  • Dissemination methods and strategies

    In this activity you'll consider how evaluation findings can be dissemination within and beyond an institution, and how to gain feedback from stakeholders. You'll also produce a draft dissemination strategy for your assessment.

  • Week 11 review

    In this activity, you'll assess your learning with a short quiz, reflect on your study of this week's material and prepare for next week. The Help Area provides an opportunity to ask the course Mentor questions.

• Week 12

  Conclusion and assessment preparation

  • Assessment overview

    In this activity, you'll explore the five parts of the assessment and the criteria against which your work will be assessed.

  • Important guidance about your assessment

    In this activity, you'll be given information about using quotes, referencing and the process for submitting your assessment.

  • Thank you and good luck!

    In this final activity, we wish you well for the future. Thank you for joining us on the course!