Learning Design becomes mission critical

In my last posting I suggested that a module specification could usefully have four sections, clearly articulated, for Intended Learning Outcomes, so that a student could identify from their assessment evidence that they had met specific ILOs in a range of domains. In doing so they not only have a useful platform to identify future learning needs, but also the potential to negotiate the accreditation of prior accredited learning in a much more fine-grained and meaningful way, something I fully expect to become a significant future of international higher education accords in the next few years as institutions face up to the challenge of accredited OER schemes and credit bearing MOOCs. I believe the design of intended learning outcomes for modules and programmes will become a strategic priority.

Not everyone agrees ILOs are effective and a useful critique from Hussey and Smith is well worth reading (Hussey & Smith, 2002).

How many Intended Learning Outcomes (ILOs) one designs into a module or a programme level specification has to depend on the scope of the module or programme itself. I’m sure colleagues can adapt what I’m saying here to their own quality assurance and institutional contexts.

For the purpose of this reflection let me take a single module, worth 15 credits. In the UK context this would frequently represent one-eighth of a stage of undergraduate degree study, there being three stages each representing 120 credits. Again, in the UK context there is a strong notion of progression in higher order thinking skills between the first stage of undergraduate study (level 4) and the final stage (level 6). This progression is articulated in generic guidance that captures much of this ILO debate and in subject specific guidance drawing on the discipline communities to create ‘benchmarks’ for what be expected to be in any named award (www.qaa.ac.uk) . Level 5 would represent the second stage of undergraduate study in the UK context, the equivalent of an exit point for a Higher National Diploma or a Foundation Degree, the European Qualifications Framework Level 5 and within the EHEA (Bologna) sometimes referred to as a ‘Short Cycle’ award.

My example then is for a 15-credit module at level 5. The UK quality assurance agency does not specify periods of study for credit, but sector norms talk in terms of notional study hours and it is perhaps helpful therefore to think of 15 credits as 150 notional study hours, 30 credits as 300 notional study hours and so on.

The Domains

Before proposing a model for ‘how many’, I will briefly remind myself what these four sections, or domains, of Intended Learning Outcomes represent. They are;

  • Knowledge and understanding – subject domain
  • Intellectual Skills – or the cognitive domain
  • Professional Skills – or the affective domain
  • Transferable Skills – or the psychomotor domain

Knowledge and understanding – subject domain

The subject domain is often conflated with the cognitive domain, which is understandable as it is within Bloom’s ubiquitous taxonomy, but this does tend to confuse faculty as to the distinction between knowing and understanding a body of factual knowledge and being able to do something with that factual knowledge. The Subject domain can, and in my opinion should, be limited to defining the subject area for illustrative purposes for the student. Since the principle is that all Intended Learning Outcomes should be assessed and it is actually rather difficult to assess whether someone ‘understands’ something without having them ‘operationalize’ the knowledge, I tend not to get too hung up on the active verbs used in this domain, contenting myself it serves to contextualise what follows, but maybe I should and another post later will unpack Anderson and Krathwohl’s Knowledge Dimension in more detail.

Intellectual Skills / Cognitive domain

This domain refers to ‘knowledge structures’ building from the base of the Subject domain, the “knowing the facts”, towards high order thinking skills in which these facts become operationalized and transferable. This domain is familiar to most faculty and synonymous with the work of Bloom from the 1950s (Bloom, 1984) and the useful revisions made in 2001 (Anderson & Krathwohl, 2001).

Professional Skills / Affective domain

The affective is concerned with an individual’s values, and includes their abilities with respect to self perception through to abstract empathetic reasoning. In an extension to the early work by Bloom progressive stages take the learner from foundational ‘receiving’, through to the ‘internalization’ of personal value systems (Krathwohl, Bloom, & Masia, 1999). In the context of Higher Education programmes, particularly an era when the employability of graduates is stressed, an awareness of these professional values would do well to be built into the relevant modules.

Transferable Skills / Psychomotor domain

The psychomotor domain is less well researched and documented and this has meant a less than adequate recognition and incorporation into learning designs. Frequently tactile or technical skills become seen as ‘general skills’ or ‘transferable skills’ and there is little sense of progression. This domain refers to progressively complex manual or physical skills and so could identify the progressively complex skills of a biologist in using microscopes, or an economist using a statistics software package (Dave, 1967). I find this domain unfortunately neglected as I believe it would enhance course designs if note were taken of the practical technical skills required within disciplines and their articulation in Intended Learning Outcomes.

The Balance of Numbers

The actual balance between these domains in terms of how many Intended Learning Outcomes one might assign to them in the context of a 15 credit module will depend on the context of the module, its mode and its programme context. One might reasonably expect to see some differences in the balance of ILOs in modules in different contexts, illustrated below.

Domains Level 5 University class taught Module

;

Work-based Level 5 Management Module Practice-based Level 5 lab taught
Knowledge Domain 2 2 2
Intellectual Skills (cognitive) 4 2 2
Professional Skills (affective) 2 3 2
Transferable Skills (psychomotor) 2 3 4

And for those who appreciate a visual representation:

Distribution of ILOs in different domains

;

In this example each module has ten Intended Learning Outcomes but the emphasis within the module will change. Whilst it may be appropriate to stress intellectual skills (analysis, synthesis, evaluation) in a classroom based political science course for example, on might expect to see transferable skills (often described as practical, tactile or technical skills) stressed in a technical lab based course, skills such as manipulation, articulation and naturalisation of technical proficiency.

Holistic Learning

All too often Higher Education stresses the cognitive, over reliant perhaps on Bloom’s taxonomy and related work, and neglects the affective and psychomotor domains. This is has several consequences; it relegates anything that is not seen as ‘intellectual’ to a lower order of skills despite the fact that employers and students recognise and demand the need for broader skills (Mason, Williams, & Cranmer, 2006). In doing so it forces programme leaders into ‘bolt-on’ skills modules that demand additional institutional resource and student resource and frequently ill-serve the purpose. No learning design is truly student-centred if it is neglecting other domains of experience (Atkinson, 2011).

The model advocated here separates the knowledge domain and the intellectual skills, focussing the module designer on the ‘skills’ that will be acquired independent of the subject knowledge acquired. This, along with a focus on the affective and psychomotor skills, provides a framework for a module that is balanced in terms of what the student does, the context in which they do it, and correctly assessed ensures all these intended learning outcomes can be justifiably claimed in the student’s transcript.

Indeed it is not difficult to imagine a student coming to the end of the first stage of their degree, recognising that they have excelled in the psychomotor skills but struggled in the cognitive, and make module choices for future stages either to redress that balance or acknowledge their strengths and adjust choices to reflect future career path.

So how do you write learning outcomes across these four domains? That’s the subject of the next posting.

………………

Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing : a revision of Bloom’s taxonomy of educational objectives. New York: Longman.

Atkinson, S. (2011). Embodied and Embedded Theory in Practice: The Student-Owned Learning-Engagement (SOLE) Model. The International Review of Research in Open and Distance Learning, 12(2), 1–18.

Bloom, B. S. (1984). Taxonomy of Educational Objectives Book 1: Cognitive Domain (2nd ed.). Addison Wesley Publishing Company.

Dave, R. (1967). Psychomotor domain. Presented at the International Conference of Educational Testing, Berlin.

Hussey, T., & Smith, P. (2002). The Trouble with Learning Outcomes. Active Learning in Higher Education, 3(3), 220–233.

Krathwohl, D. R., Bloom, B. S., & Masia, B. B. (1999). Taxonomy of Educational Objectives Book 2/Affective Domain (2nd ed.). Longman Pub Group.

Mason, G., Williams, G., & Cranmer, S. (2006). Employability Skills Initiatives in Higher Education: What Effects Do They Have On Graduate Labour Market Outcomes? National Institute of Economic and Social Research. Retrieved October 14th 2012 from http://ideas.repec.org/p/nsr/niesrd/280.html

Intended Learning Outcomes matter

MOOCs, self generated OER based curricula, kite-marking schemes, and elaborate credit transfer schemes are a reality in increasingly complex higher education sector. Students often pursuing studies from within the world of work where physical mobility of employable precludes commitment to a single campus based programme over four years require well defined, constructively aligned, module designs. Clever module design means clever programme design, clever portfolios and successful institutions. Learning design is no longer just an issue for the Quality Office; the Strategy people are beginning to care too.

The vast majority of UK Universities now are able to produce detailed module and programme specifications for their teaching programmes. Specification templates usually detail the aims and objectives, resources, indicative scheme of work, staffing and mode of delivery. They also routinely use a template to generate the Intended Learning Outcomes (ILO) for the module or programme. Frequently divided into three or four sections covering, knowledge and understanding, intellectual skills (cognitive domain), professional and practical skills (affective domain) and general transferable skills (psychomotor skills), these templates are completed with varying degrees of comprehension as module validation panels will attest.

The logic is that to achieve a well-structured and constructively aligned curricula, the module team should determine what the ILOs for the module are to be (Biggs & Tang, 2007). What will the learner be able to do at the end of the module? Having determined the ILOs the team would then determine how they would enable the student to demonstrate achievement of the outcomes and draft an appropriate assessment strategy. Then, and only then, the module design team would look at what the student needed to be able to demonstrate and work out what was needed as input. Outcomes first, assessment second, teaching inputs third.

It’s not an easy thing to do. As teachers we’re passionate about our subjects, anxious to impart what we know is important, what ‘did it for us’, and at some point in this process many faculty will ‘go native’, reach for the seminal text (or the nearest thing to it, their own book), and start thinking about what the students need to know. This can of course produce fantastic learning experiences and there are a great many exciting modules drafted on the backs of envelopes without specification templates. They don’t make for effective records of achievement however.

Accreditation of prior accredited learning has always been a challenge. An effective template for module and programme design makes a significant difference. Students should be able to identify from their transcript exactly what it is they can evidence as intended learning outcomes. I would argue further that phases in learning and teaching activity should also have notable objectives that map directly to the ILOs (See the SOLE model described in Atkinson, 2011).

So how many intended learning outcomes, how many affective, how many cognitive, how many is too many? My next post will be my reasoning on that issue.

Atkinson, S. (2011). Developing faculty to integrate innovative learning in their practice with the SOLE model. In S. Ferris (Ed.), Teaching, Learning and the Net Generation: Concepts and Tools for Reaching Digital Learners. Hershey, PA: IGI Global.

Biggs, J., & Tang, C. (2007). Teaching for Quality Learning at University: What the Student does (3rd ed.). Buckingham. GB: Open University Press.

%d bloggers like this: