Welcome all, please feel free to share this video with colleagues if you think they would find it of interest.
Let's talk today about building professional relationships. Teaching can be quite a lonely experience. Depends a little bit on the organization that you teach in. You might be teaching in a very isolated part of the world, or you might be teaching a very specialist discipline. You might be the only person teaching that particular subject in your school, even in your area.
And having good connections with other practitioners that understand you, understand your context, definitely do serve to lower the level of anxiety that you might feel. There's evidence to suggest that well- connected educators do suffer less anxiety.
So reaching out now is much easier. There are any number of digital platforms that you can engage with and connect with other people. And in doing so you benefit not just that level of human connectivity, but you're also using them as a source of new ideas, new sources, new perspectives.
It's very important if you do get involved in any of these platforms that you do become a contributor, as well as a consumer. That's not just because that's fair. It's just, it's also that echoing your voice is really important, using your voice to mirror the practice of others is part of the process of building those relationships.
Even if it's just to go back to someone who's posted something, you found a value to just say "I've used what you suggested. It worked very well for me" or it didn't and I made this adjustment, and I did it this way. Having that level of feedback is really important.
So, I'm on a number of different platforms. I'm on LinkedIn. I'm on Twitter. I'm on Instagram. I'm on Tik Tok. I'm on YouTube and I've got my own website, but I think the two that everyone needs to start with are Twitter and LinkedIn. Build a profile on LinkedIn, doesn't have to be expansive, but at least something that gives people a sense of who you are as a person.
And then Twitter is a great way of just picking up ideas, sources, perspectives, re-tweeting things that you think are of interest, identifying things more widely, and posting them and share that community experience. You'd be surprised how quickly it does build and giving you a solid network to lean on will undoubtedly reduce your anxiety.
So you might want to try some of those platforms for yourself. See how it goes.
Welcome all. Please feel free to share this with your colleagues, if you think they'll find it of interest.
Let's talk about how you make time in your learning. We all have a very busy curriculum. We have a lot of 'content' to get through a lot of concepts and learning, to convey to students during any one session. I think it's really important that we make time for learning. I think teaching is better equated to a version of television rather than of radio. There's a concept in radio of 'dead air. Every, every silence has to be filled. That's not true in television. If you've got something visual to look at, you don't need to provide words to go with it.
So unless you're developing podcasts for teaching, I think there'll always be a visual element in any teaching encounter that you're designing. There's no need to worry about the dead air.
And in fact, a well-planned teaching session will always have space built into it, time built into it, to allow for some quiet reflection. And I think you do need to build that into your session at pertinent points, during any session that you're delivering. So you can build in reflective questions.
For example, something I used to do literally to put up a slide that would have a question on it and just say. We are going to pause for a minute. I'm going to encourage you to think about that. Make some notes. Sometimes students might start talking to each other. That's not necessarily a big problem. It's only for a minute. It gives you a chance to gather your thoughts, have a glass of water, but it also paces the session quite effectively.
So please have a go try something similar. Let me know how it goes. Be well.
Welcome all. Please feel free to share this video with colleagues, if you think they would find it of interest.
I want to talk today about engaging students about the need to mix it up a little bit in terms of the way that we deliver our learning, the way that we engage our students. It is important to be consistent from a quality perspective but to avoid repetition. And it's very easy to make an excuse and say, well, "this is the room that I've been allocated, to teach in", or "this is the confines of the webinar space that I'm being expected to operate in". And that becomes a defense mechanism on the part of educators. So this is the way this is the way it's always been done. "This is the way the lectures work. This is the way it's done."
And I think we need to avoid that.
It's important that we focus on the notion of engagement of the learning we need to think about, what's going to provoke the learner, provoke the student, to engage with the concepts and the knowledge that's being shared or imparted.
And that doesn't necessarily making every session a very different form of active learning, but it does mean you have to focus in on the concepts and think about how best to illustrate those concepts. Visually, ideally. So the best way to do that is to review the concepts within an individual session and put it in the context of a broader course, and then identify whether or not you think this particular concept is best experienced through some lecture form,
or through some seminar form or through some active learning form you might throw in a moot or a discussion you might throw in a question, answer session. You might throw in a way of giving students to do peer learn from each other, even within a lecture theater, anything is possible. It's really important that you break out of the mold of doing repetitive forms of delivery. It's really important that we mix it up to maintain the engagement of our students. So look at the whole series of sessions, identify individual concepts, take a course wide view, and then map out what best form of engagement you think is going to work that ensures some variation in the learning experience.
And that's much more likely to engage, maintain, engagement of your learners.
Welcome all. Please feel free to share this with your colleagues. If you think they'll find this. Interesting. So let's talk today about how you deliver your notes. I'm going to assume that if you're delivering any kind of lecture, you will have notes and it's absolutely critical that you don't stand and read.
It's also important that you don't substitute your notes with PowerPoint slides that have bullet-pointed versions of your notes, and you end up just reading out the bullet points. There's good practice and bad practice in that. There'll be other resources available around that shortly. So, I think it's really important that you think about how you convey the message of the learning using your notes.
It's 'notes', not a script. Don't illustrate with bullet points, use as much eye contact as possible and make sure that you are illustrating key points. If you are going to use PowerPoint as a visual tool, it is a visual tool, not a text-based tool. It's absolutely critical that you recognize that the most powerful tool you have when you're teaching is your own voice.
And there are things you can do to train your voice. There are ways that you can encourage your voice to carry more meaning, more conviction, and there'll be resources about that coming out shortly. So I tend to rehearse at least part of any presentation. I don't always rehearse the entire one hour lecture or 40-minute lecture or 35-minute lecture, but I will always try and rehearse at least part of it to make sure that the tone is right, that the notes are structured in such a way that they will support what it is I want to teach.
So I would suggest that you try something similar. Let me know how it goes. Be well.
Welcome all. Please feel free to share this with colleagues. If you think it would be of interest to them. So, today I want to talk a little bit about why it's important to plan your sessions. This is particularly pertinent if you're delivering a stand-up lecture, that's expected to keep students engaged for 40 minutes, 45 minutes, but even in a normal session, a normal seminar session, it's still really important that you plan. Down your session. It's really important that you don't plan around the content. And rather you plan around the learning experiences. We can almost take them as synonyms. We would almost say content and experiences are the same, but it's really important that you think about how the student is hearing that content, how they're engaging with that content rather than just delivering them raw content.
I think it's also really important as you plan out those linkages, those connections between the experiences in your lecture, that you don't use a hundred percent of the time, certainly lecturers when they start their careers, if they're not particularly confident, they will walk into a lecture theater, start delivering, keep talking and leave at the end, in order to possibly avoid confrontation, avoid questions.
And once you've found your feet, you will be able to use the time really effectively. And I think it's important that you plan possibly for up to 80% of the session to be around the learning experiences, the guided experiences that you were expecting to share with students, and leave 20%. at the end. Sometimes people say, what do I do if people don't have questions, if students don't ask anything, how do I use that time?
There, there are a number of ways that you can use that, but it is important to have a, almost an Encore in the way that a musician is expecting to come back onto the stage and perform again. we don't usually get, rounds of standing ovations for our teaching, but very often having an Encore is really important.
It's almost the most important thing because it's the last thing that the student is going to experience. So it can't be something that is core. Can't be core content or core content experience because you might not get your opportunity. The session might go long and it's dangerous to leave the best to the end, but it has to be something that's reinforcing something that's empowering and it's worth actually concentrating really on what that Encore is going to look like.
And then build the session back. If the session does go a little bit long, that Encore needs to be able to be prepared either as a short video interaction to go up on the website on your, virtual learning environment, or possibly. Yeah, featuring featured in a handout, but it's really important that you plan out the experiences for 80% of the session, and link them together, conceptually through good planning.
There are some templates that you can use for planning sessions, a search on the web would find any number of them. I've also got one on my website as well. If you do want to access that.
Just give it a go. See how it goes. Let me know. Be well.
There are many courses out there that do a great job of teaching manual, dexterity and physical capabilities. From bricklaying, hairdressing, to gas-fitting, there are course that are focussed around manual processes. However, there are huge numbers of graduates from tertiary programmes that cannot perform duties required of employers on day-one simply because they have not learnt how to do something. Their learning may have been told ‘why’, and even ‘what’ is expected, but it has not enabled them to perfect the skills associated with the ‘how’.
It remains remarkable to me that so many course and programme specification documents, replete with (sometimes well-formed) learning outcomes, have NO psychomotor outcomes. There are few courses that could not be improved by including an assessed outcome associated with using a tool or technology.
To prove the point I asked colleagues informally before Christmas whether they could think of a course where there was NO tool or technology use in play. Without further prompting, most agreed that Excel skills, SPSS, CAD tools, even library databases all required a degree of incremental competence but that these had not been in any way ‘taught’, let alone assessed, within their courses. One provocateur suggested that their course required only the ability to write and reflect. It took little effort to unpick this given that writing in this context requires a word-processing package, formatting, style sheets, spell-checking and in-text-citations, all of which are assumed graduates skills. This colleague stood their ground, suggesting that they were not employed to teach those skills; that was someone else’s responsibility.
This may be at the root of the challenge. Thirty years ago (when many of our current educational leadership graduated) your three to seven years spent at University was a valuable time spent in proximity to the sources of privileged knowledge, the esteemed Professor or the library. You had a whole life after graduation to develop the rounded skills associated with being whatever your chosen lifetime employment might be. That is simply no longer the case. The ‘academy’ no longer contains the privilege knowledge. We have democratised the information sources. Even those who embark on a lifelong vocation will find the landscape around them continuously changing.
Access to the LinkedIn Learning resources, and the cornucopia of free web resources, has allowed some institutions to negate whatever obligations for manual, dexterity and physical skills development they might feel towards their students. Some course weave these external resources into the learner’s experience, others totally abdicate responsibility and deem it part of the independent learning required of learners.
One reason for this lack of attention paid to the acquisition of psychomotor skills is because it is thought harder to assess someone’s psychomotor skill set that it is to test their knowledge, and by extension their intellectual or cognitive skills. If I can’t meaningfully assess it, I’ll just avoid teaching it. It is also a function of the ‘curse of knowledge’, given that faculty have acquired their psychomotor skills in a particular technology or tool over an extended period of time and they have failed to either document that learning or indeed to reflect on it.
There are some well designed courses out there. I hope you designed or teach on one. But there is still a significant deficit in the in-course provision of support for the acquisition of psychomotor skills associated with tools and technologies in a range of disciplines. We need to design courses across ALL disciplines that are rooted in the skills that graduates require to handle the uncertain information, technology, and socio-cultural environments they face. This means designing courses first around psychomotor skills, interpersonal and affective skills, then meta-cognitive and cognitive skills. Then, and only then, should we worry about the factual knowledge element. We need programme and course designers to be designing with different priorities if we want to make learning appropriate for the contemporary learner.
With the disruption to delivery models, timetables, and staff and student expectations in the last 18 months some institutions are struggling to maintain their faculty’s motivation and commitment. Some are wrestling with changing notions of autonomy and accountability.
With the disruption of delivery models, timetables, and staff and student expectations in the last 18 months, some institutions are struggling to maintain their faculty’s motivation and commitment. Universities are struggling to balance the need to provide their academic staff with more autonomy while ensuring they remain accountable.
Some academic staff still hark after the glorious days of academic self-management. The danger is that it doesn't take much for that 'autonomy' to be abused; The elderly professor earning the salaries of three junior colleagues, applying fruitlessly for funds for arcane and irrelevant research, with no PhD supervision duties and no teaching, is not as rare as we like to imagine. Such individuals demonstrate to newer faculty that they can achieve career advancement by being selfish. This breeds a culture in which those with a relatively light workloads do their best to appear overburdened in order to defer requests from others to 'pitch-in'. Most of us can identify such individuals.
The balance between academic autonomy and accountability defines the character of an institution from a faculty perspective. Autonomy and accountability are reflected in large part by how an organisation articulates leadership and management, two concepts that are frequently conflated inappropriately.
Leadership is about enabling with vision, providing clarity of purpose, illuminating the path ahead. This means communicating a clearly defined future state; a vision. Leadership does not require seniority. We often look to colleagues that we know to be skilled and confer the mantel of leadership on them. You can develop leadership skills, but usually within a specific context. A leader in one organisation at one time does not always adapt well to a different context. Some prove adaptable, but not all. Leadership is about empowering others to be more autonomous.
Management is quite different. Management is about implementing, maintaining, and curating structural processes within a given context. Everyone self-manages by this definition (calendar management, time-booking, etc). Beyond self-management, most organisations create tiers of managers to maintain policies and practices, to fulfil something externally imposed whatever legislative regulations or quality standards. Management is ensuring accountability.
We require leaders to trust the people they have responsibility for. Leaders need to provide supportive autonomy. Managers do not have to trust their people because they have tools to track them. They have instruments for accountability. It has been said that leaders make sure that the right things are done, managers make sure that things are done in the right way.
Autonomy and accountability are two sides of the same coin. While some institutions have released faculty to get their own courses onto the institutional virtual learning environment, others had more structured approaches. In both cases, many have been unprepared for what changing models of delivery mean for accountability. Student complaints have surprised some institutions, mostly about the inaccessibility of faculty in the digital context. Students expectations need careful management. This does not need more systems to monitor faculty-student interactions, or appointing more people to watch people, and people to watch the watchers. It requires that new social-digital contracts be negotiated among all the participants and stakeholders in the University ecosystem.
Universities face challenges with some students and faculty struggling to adjust to the demands of balancing workload and practices of supporting flexible online provision. Going 'back to normal' for some will simply not be possible. This is a time when leaders and managers need to work together.
Managers need to hold the freeloader Professor and the 'too busy' junior colleague to account. Leaders need to define the future state of Universities in a language that faculty and students can make sense of. Together, they need to define, negotiate, explore and define new concepts of accountability and autonomy.
We need to continue to move away from seeing tertiary education as the imparting knowledge and see it rather as developing the skill of all students to be able to decide which learning pathways best suits their context, prior experience and aspirations. One of the consistent messages I try and instil in others' practice is the importance of the social context in which the student inhabits.
In November 2018 I contributed to an EDEN online webinar talking about 'Innovative Education' as part of the 2018 European Distance Learning Week. Here is my presentation, entitled "Designing Pathways: which way to innovation?"
I have been rather busy of late, so this is a rather delayed post from an interview done in June 2020 with SRCE, the Croatian National e-Learning Centre. The Interview appears under the title "Student je središte obrazovnoga procesa", which translates as 'The student is at the centre of the educational process'. Below is an English version of the extended interview.
SK: How does one transfer face-to-face (f2f) courses to an online environment?
Carefully! The difficulty is that the honest answer is "it depends". It depends on several factors. Whether your institution already has a robust infrastructure to support learning online, is there already a virtual learning environment in place, and how well is it being used and supported? What are the relative skill sets of the technologists, educational technologists and academics? Has the institution already predetermined a learning and teaching strategy that defines the nature of the blend of online and face-to-face provision, or has it just been left to develop organically as the technologies have become more and more widespread?
There a strategic challenge for institutions, beyond the influence of most front line teachers. I think the challenge is that language, certainly in English, is very changeable and often misused. Managers mix up phrases like the 'flipped classroom' and 'blended', or they associate 'online' with 'remote' learning. I think it is worth investing some time at an institutional level to agree on what you mean by the terms you use. Otherwise, people can talk across each other and misunderstand both each other's context and meaning.
Institutionally, we need to think about the human element. Recognising that the skills to design learning and teaching online, whether to overcome the short-term lack of classroom contact or for longer-term distance learning purposes, are not the same skills required of face-to-face teachers. Most online distance and flexible learning organisations (ODFL) have created many specialisms within their workforce. Many traditional institutions still expect individuals to play a range of unique roles and so moving these online is increasingly challenging. We need to confront the fact that the change of environment means a dramatic change in roles, and that won't fit everyone's personal or career aspirations.
SK: And for an individual teacher's perspective, what should they be thinking about?
I would suggest that the first thing anyone should do when moving a course from face-to-face to online is to be honest with themselves. It's an opportunity to look for quality enhancement. In the short term you may be compelled to move existing presentation material online, the resources you might have delivered in a lecture, and wrap around that some discussion forum to substitute what you might have done in a seminar. Readings are less of an issue. But in the medium term, and in the long term, we need to recognise that designing learning for online delivery is an entirely different experience from face-to-face. So I think there is a perfect opportunity to dismantle your existing course, challenge your assumptions, and go right back to the basic design elements within your courses.
I think it is also important to avoid taking a deficit mindset around online, by which I mean to think that online or distance learning is 'worth' less than traditional face-to-face learning. The evidence suggests the opposite but what is true is that they are significantly different experiences from a student's perspective.
Most courses have been designed around course outcome statements. Ordinarily, these are written statements as to what the student will be able to 'do' once they've completed the course and these guide both assessment, learning activities and content. If your institution doesn't follow this approach, it's not too late to do it for yourself. Writing good learning outcomes provides a structure for both the learner and the tutor. If you've got learning outcomes already in place for your course, go right back to them and re-conceptualise your learning approach, knowing the context in which your students are now learning.
There is an assumption that when the student is on campus and sitting in the classroom, they are a captive audience, you can monopolise their time for the one or two hours that they are timetabled. In an ODFL context, students' time is out of your reach. That means the learning itself needs a degree of motivation and structure built into it. The consequence of this is that you design learning that requires the learner to build on their own experience, to situate their learning wherever they are, and seek out authentic learning opportunities. I believe as a result, ODFL can produce much better learning than many face-to-face instances where there is the danger that given the captive nature of the student, they can be subjected to content lead learning design. So my key message is to be as honest as you can be about the quality of the learning experience rather than being overly concerned with the quality of your content. Focus on the learner experience.
SK: So what practical steps can teachers do to achieve that?
First, I think the best teachers are reflective practitioners. They are continuously asking themselves whether they are serving the best interests of the learners from a learning perspective, not from a subject content perspective. The reality is the vast majority of factual knowledge delivered through our courseware is available to students free if they know how to find it. What we do as educators is we synthesise, organise and order this knowledge into meaningful experiences. Some of our colleagues may have been teaching for 30 years in a face-to-face environment and now teach online for the first time, some of them I know feel like they're teaching for the first time! The COVID-19 pandemic is a significant opportunity, despite unfortunate circumstances, to confront everything about what we do. Teachers need to be aware of their own strengths and weaknesses. So keep a journal, reflective notes, annotate your presentations, make quick observations after each teaching encounter. Get into the habit of challenging yourself as to what you could have done differently and what you plan to try differently next time.
Second, teachers need to know that they are not expected to do everything by themselves. Indeed, I don't think anyone can do everything. There is a reason ODFL organisations have so many interwoven specialisms. I think it's important to recognise that learning design, course design, is neither a science nor is it a dark art. If it were a science, big organisations would've already found a way of making an engine where you put in your requirements and of course comes out the other end, but despite their best efforts that appears not to be on the horizon. Likewise, good course design and good teaching, with some very rare exceptions, are best done in broad daylight, and with peer review, rather than behind the closed doors of a dark lecture theatre. One of the positive effects of the expansion, or massification, of higher education in Europe and globally is that it has compelled greater transparency in learning and teaching practices. So teachers need to know enough about themselves, so they know when to ask for help.
Third, and it's a related point, is when there is no immediate support if your institution just doesn't have the staff to guide you in developing good online learning, reach out. Look for support from many international organisations that have provided resources to support you and your colleagues. I'm aware of resources that are shared by EDEN, ICDE, UNESCO and others. I think it's important that teachers know that they are not alone and that regardless of the discipline, whether its undergraduate dance or postgraduate chemistry, someone, somewhere will be trying to solve the same challenges you face. I, like many others, share resources openly on blogs and institutional websites. Use them.
SK: How can teachers ensure that an online course is not simply a repository of learning materials?
Good learning design would never result in a simple repository of learning materials. It just can't happen, that's a contradiction. It's the equivalent of a face-to-face teacher handing out a reading list for their and doing nothing else. Good learning design puts the learner experience at the heart of its design; resources complement the experience; they don't replace it. I think sometimes we associate with having students physically present in our classrooms means that they are engaged. We assume that they are listening and that they're paying attention. We may have designed in-class activities, and the students may be actively engaged with them, but a lot of our teaching is still very passive. Sometimes when teachers move recorded lectures, presentations, PowerPoints and notes online but are not being 'present' to facilitate any engagement with these resources, they are left wondering whether they have any value. They may wrap a discussion forum around resources and engage the student in a meaningful dialogue amongst themselves and with the tutor, but when this dialogue fails to happen that can be very frustrating. Some students engage some don't, and there is no immediate way of resolving that I'm afraid. We would have to explore questions of motivation, discipline-fit, literacies and a range of other things which I think is a bit beyond the scope of this conversation.
However, I will say that good learning design would suggest that rather than providing a resource and attempting to get the student to engage with it, it is better to envisage the learning experience and use resources only when it is appropriate. There is nothing wrong with students spending time reflecting, looking for other sources of information to validate what is being given to them or creating online resources collegially or individually. We need to get away from this myth that we, as teachers, are the source of all wisdom. Some students will experience poor learning during this COVID-19 emergency that we all face. But it's important to recognise that that is not implicit in the ODFL experience, it is likely to result from several assumptions and presumptions that have informed less than ideal practices. Moving courses online is challenging many personal assumptions that we have.
SK: Let's talk a little more about assessment in an online environment. How it differs from f2f and how to do it?
Gosh, that's a huge question. In some ways, the design approach shouldn't be any different. Every institution should have an assessment strategy, and arguably every programme and every course needs to have a refined version of that strategy written into it. Assessments, regardless of the mode in which they run, should be valid and reliable, but they should also be authentic, durable and situated. Just to explain my language here; valid in that they assess the outcomes and not content, reliable in that you could expect to repeat the assessment with future cohorts and get comparable results. Authentic because it is appropriate for discipline and level, durable because ideally, we wouldn't want to keep re-writing assessments each time we deliver a course, and situated in that the assessment allows the student to personalise their evidence.
If you start on that basis, and you look at whatever the learning outcomes are for your course, re-conceptualising assessment becomes less daunting. It should be less about how you adapt your existing assessments to deliver them online; rather, it should be to take an online approach to assess your outcomes. I recognise that for some colleagues, the conventions within their disciplines are incredibly rigid. They may feel uncomfortable about even suggesting that the sacred cow that is the 'final exam' may not even be necessary. I understand that. But, there is a strong argument to be made where assessing learning outcomes differently represents a quality enhancement opportunity.
SK: So, how does a teacher decide on the assessment method for online?
I would say first that people need to be thinking about 'originating' not 'replicating'. Forget about trying to assess the same way online. The learning outcomes dictate the assessment method. Without them, I suspect it's just about what's realistic within your institution. If your outcomes require factual recall and memorisation, then the assessment method might be as straightforward as a multiple-choice questionnaire embedded inside the virtual learning environment. Any higher-order thinking skills, to discuss, to debate, to analyse, to evaluate or to critique, are likely to require long answer text forms. The question is how authentic that assessment can be. Many institutions still have a tendency to run exams, I think often just because they're configured to do so rather than because it is actually assessing any defined outcomes. Unless you're assessing someone in policy studies or journalism who is required to show an ability to write under pressure, exams risk assessing merely the ability to sit exams or memory rather than any higher cognitive functions. I think it's important to think about what it is the students actually providing evidence of.
One of my biggest professional frustrations has always been with teachers who say they want their students to be able to identify, research and critically evaluate a range of complex sources in order to synthesis or analyse a situation, and then they set a three-hour exam based around the content in the course. Assessment is undoubtedly one of the most challenging areas of learning design but incredibly satisfying when you get it right!
Clearly, outside of the social sciences, there are other assessment challenges. In the performing arts one may have inferred, but not written into an outcome, the ability to perform in front of an audience for example. In the long run, one may need to rethink the way those outcomes are written, but in the short term, it is entirely possible for students to provide recordings of performances in their own time, in their own space. Some might object to allowing students to perform something multiple times and submit their best effort. I don't see that as a problem unless the learning outcome suggests that the student only gets one high-pressure opportunity. Again, I think it depends on what it is you're assessing.
I think it's important that we try to avoid thinking about how to replicate what we do face-to-face online and go back to the fundamentals of our learning design. We can arguably make adjustments to most of our face-to-face intentions by adopting an ODFL mindset.
SK: In your view does online assessment provide an equally relevant assessment as that in f2f?
Relevant is an interesting choice of word. I suspect what you are alluding to is the fear that many colleagues have about plagiarism or academic misconduct away from the exam context. You cannot just post a 'standard' exam online and not expect students to go into their social media groups and exchange information, download answers from the Internet, or even buy a response. The alternative might be running online proctored exams, but I'm not in favour of that. Unless writing within strict time limits like a journalist is an outcome, I think it's unnecessary. Instead, I think we are better to be thinking about the assessment from where the student is standing. We need to conceive of the learner, online and distant, living away from campus, and having access all the course content. They don't live on the moon! They are part of society, so we need to design learning, and assessment, that encourages them to personalise their own context.
I want to unpack the word relevance. Whether the assessment is valid and reliable is about whether the skills you want the students to provide evidence of is captured through your assessment design, and if you repeat the assessment, the results are likely to be equivalent. So designing valid assessment determines its relevance. I think it's important wherever possible to design assessment that is authentic and situated. Authentic means that the evidence the student is expecting to provide of their learning should be as close to real-world experiences as possible. It always surprises me that institutions go to substantial lengths to create scenarios and case studies when the real-world is just outside the students' windows! Situated means that the learner should be required wherever practicable, to draw on experiences and realities in their own context. This means they could be asked to create a case-study based on something within their social context. What could be more relevant?
As I've said, I think it is arguably easier to provide situated and authentic learning to students who are studying away from the campus and away from an existing cohort. If a student has to situate their learning, and therefore their assessment, it is often easier for teachers to become familiar with an individual's student's pattern of learning. Where a teacher is aware of their students' strengths and weaknesses, they will recognise evidence of academic misconduct more readily. Many institutions now teach at a scale that means individual teachers are not assessing their own students directly. I think if we design assessments to be authentic and situated; it is possible to design out plagiarism. I suspect that is the holy grail in assessment design. Ensuring that students can make the learning, and therefore also their assessment, as meaningful to their own lives as possible. Forcing students to provide context for their learning means cutting and pasting from the Internet becomes more of a chore than it is an advantage.
SK: What final words would you like to share with colleagues here in Croatia?
To say that I respect the commitment and tenacity of teachers, and I admire how they have coped under extreme pressure to do what's best for their students. To say that I think being reflective, understanding your strengths and weaknesses, asking for help when required. Thinking from the Online Distance Flexible Learning (ODFL) position back towards the campus, rather than the other way around, is the way to tackle the personal challenges ahead. Also, if I might add I have fond memories of my visits to Zagreb and hope to visit Croatia again.
I believe it is important to design learning from the learners perspective. That means learning that is both relevant, meaningful and motivating but also that is realistic and feasible within an agreed timeframe. This is a very brief explanation for those new to designing courses of how to work out "how much is enough?"
I believe we should calibrate our learning to take account of the 'notional study hours' or NSH (alternatively referred to as 'Notional Student Hours').
The calculation may vary from the country by country. In tertiary institutions in the United Kingdom, New Zealand, South Africa and other jurisdictions, a single academic credit equates to 10 hours of student learning. In the European Credit Transfer Scheme, one credit equates to 25 to 30 hours. My explanations below take the UK/NZ model and assume that a single course, worth 15 credits has an NSH value of 150 hours. A full-time student would be expected to study eight such courses in a year, 120 credits in the first year, 120 in the second and so resulting in 360 credits for a three year degree.
Remember that the NSH is the total students are expected to study to earn their credits, NOT the amount of time you have to be guiding them. Work out what time each week you are expecting students to spend on independent study (without any guidance from you) and what time you are responsible for guiding them on. This last number that is most important to faculty designing courses.
Here is a simplified list of actions that all Faculty might want to enact:
Review the course documentation (check level and benchmark statements from national or regional quality assurance agencies)
Remind yourself of any assumptions made as to prior learning
Remind yourself of the learning outcomes for your course
4. Remind yourself as to the credit weighting and work out for your course NSH
1 Credit = 10 hours NSH
15 Credit= 150 hours NSH
5. Remind yourself of the number of hours expected to be guided, as opposed to independent study.
Institutions sometimes have different interpretations of national guidance. Usually, they see a decline in the number of guided hours as you go up the level. First-year undergraduates receiving more guided hours (65%) than masters students for example (33%)
6. Remind yourself of the assessment hours allocated to your course.
It is not uncommon to deduct a number of hours for overall assessment tasks, these are usually included in the independent study hours. So say we deduct 30 hours off the 150 hours for this 15 credit course.
7. Then do a calculation of the number of weeks over which your course is expected to run and divide the NSH of the course by the number of weeks. This will give you the number of notional study hours (NSH) for your course per week
We would then take the remaining 120 hours, work out what percentage of that was appropriate for guided learning hours (@ first year let's say 120 x 0.65 = 78)
Divided by the number of weeks in a course (say 12) that would mean in this example we would be expected to provide learners with (78/12) 6.5 hours of guided learning.
You need to work through an example based on guidance from your own quality assurance colleagues to ensure you stay in tune with regional or national guidelines.
What is essential is that you do not see the guided learning hours as time spent directly with students. It includes anything you direct a student to watch, read or listen to. Any activities you instruct them to undertake as well as any online resources you choose to provide.
It is very often the case that we are 'over-teaching' in our on-line courses. Being aware of the NSH for your course is a good place to start.