Skip main navigation

Evaluating innovative practices

In this article, Dr Chie Adachi shares a list of credible research reports and frameworks that underpin the evaluation of quality digital learning.
student on a tablet at sunset
© Deakin University
As a digital learning practitioner, you may have heard the saying ‘pedagogy before technology’. So how do we know whether technology is serving us well for enhanced online learning?
In the last few steps, we’ve looked at the people (ie digital learning practitioners) and practices transforming digital learning.
Now we’ll look at some of the ways we can identify and evaluate our practice to ensure that we’re improving the quality of digitally-enabled learning solutions.

Digital learning reports

There are a number of educational and research institutions that look at innovation and trends in digital learning, some of which include the following:
Reports such as these are useful in finding out what research tells us about how we might conceptualise and apply approaches to innovation for digital learning.

Digital learning frameworks

Let’s now look at some of the frameworks, including guidelines and standards, that facilitate the evaluation of digital learning practices and environments, some of which also lead to accreditation and recognition of innovative professional practice.
  • National guidelines for improving student outcomes in online learning


    175 Reviews
    Outlines 10 guidelines for improving student outcomes in online learning within an Australian tertiary context
  • Technology Enhanced Learning Accreditation Scheme (TELAS)
    A draft scheme currently under development by the Australasian Society for Computers in Learning in Tertiary Education (ASCILITE) that will allow digital learning practitioners to evaluate and accredit their design work
  • ACODE benchmark for technology-enhanced learning
    A benchmarking framework that facilitates educational institutions to model and self-evaluate continuous quality improvements in technology enhanced learning
  • Certified Membership of Association for Learning Technology (CMALT)
    An international certification specific to individual digital learning practitioners through submission of their portfolio work
  • Quality Matters rubric
    Eight general and 42 specific review standards that allow digital learning practitioners (from across all educational sectors) to evaluate the design of online and blended learning courses
  • Online Consortium (OLC) course review scorecard (OSCQR)1
    A rubric comprised of 50 instructional design and accessibility standards

Aligning pedagogy and technology

When it comes to balancing pedagogical and technological approaches to learning, these reports and frameworks – and the overarching criteria and aspects that emerge from more broadly – can be synthesised to evaluate and benchmark digital learning design and practices.
In essence, these standards and frameworks outline that digital learning is:
  • aligned and scaffolded: has constructively aligned outcomes, assessments, learning activities
  • social and inclusive: is collaborative, multi-disciplinary, personal
  • supported: takes a learner-centred approach, offers service and product design
  • tracked and responded: provides feedback, learning analytics
  • afforded by the appropriate use of technology: supports critical digital pedagogy, educational technologies.

Your task

Participate in one of the following tasks:
  1. Select one of the above-mentioned frameworks and standards and conduct your own further investigation. Share your summary of the framework/standard and talk about why and how it can be applied in evaluating and recognising (innovative) practices in your context.
  2. Share another useful framework/standard you know about (that isn’t mentioned here). And talk about why and how it’s useful in your context.
  1. This site requires you to register for free and you can access the latest version of the scorecard. Alternatively you can view this older version  
© Deakin University
This article is from the free online

Transforming Digital Learning: Learning Design Meets Service Design

Created by
FutureLearn - Learning For Life

Our purpose is to transform access to education.

We offer a diverse selection of courses from leading universities and cultural institutions from around the world. These are delivered one step at a time, and are accessible on mobile, tablet and desktop, so you can fit learning around your life.

We believe learning should be an enjoyable, social experience, so our courses offer the opportunity to discuss what you’re learning with others as you go, helping you make fresh discoveries and form new ideas.
You can unlock new opportunities with unlimited access to hundreds of online short courses for a year by subscribing to our Unlimited package. Build your knowledge with top universities and organisations.

Learn more about how FutureLearn is transforming access to education