Archive for the ‘ research ’ Category

Posted to Diigo 08/31/2010

    • technology is finally at a point that if we don’t use it now, then we are holding back the progress of science
    • The dominant mode of communicating research results is through peer-reviewed literature. This dates back to more than 300 years ago when scholarly societies formed and needed a way to present their findings
    • Publishers are already experimenting with the models, but they are waiting for something before going full force. They are waiting for us, the researchers
    • We could choose to publish in only Open Access. We could choose to reward tenure for Open Data. We could choose to only reward publications or data that are proven to be reused and make either a marked economic or research impact. Instead, we choose to follow a model that promotes prestige as the primary objective
    • Each time we hold back data or publish research that isn’t immediately open to all, we have chosen to be on the wrong side of history.
    • We could wait for policy changes from the top, but that is neither a timely, nor guaranteed solution
    • It is not uncommon to see research that is already two years old before it sees the light of day. This cannot be good for the progress of science.
    • “Article-level metrics” (ALM) is one step toward weaning the addiction that we have with journal impact factors. Here, we disassociate the significance of the article from the prestige of the journal that it is packaged in
    • One way to promote the sharing of knowledge, and thus be on the right side of history, is through reputation metrics. Unlike previous measurements for impact though, this would be designed to reward researchers who contribute to Open Data and science online
    • Platforms such as Mendeley can have a hand in meeting both the first and second conditions. Mendeley is more than just a reference manager, it is also a system that aggregates the metadata of millions of documents and provides authors the opportunity to promote their works
    • Those researchers who openly and quickly publish research or data for download will be rewarded.* Those who do not will adapt or risk falling into obscurity. As we wait for policy changes to be enacted by the top, we must act at the bottom to encourage a behavioral change in how we share our knowledge
    • All of our attention is focused on real and virtual classrooms and we often neglect the space between the lecture theater and the LMS. Attention, I think, needs to be given to unacknowledged learning and teaching places. Around the water cooler, between computer terminals, seated in the cafetaria, texting on mobile phones, waiting on strategically placed benches, posted on signboards, relaxing in a residence hall etc.
    • Learning designers need to think between the corridors and computers, and ask how can these spaces be used to support learning.
    • Where discussions and clarification took place either in the lecture / tutorial / virtual room, teachers and students that use networked digital devices can conduct their teaching and learning seamlessly across both physical and virtual spaces, synchronously and asynchronously
    • learning designers also need to find a way to support the creation of informal learning space between the virtual world and the classroom place.
    • If our attention is focused only between the real and virtual classrooms then it’s likely that we’ll fail in our attempt to use these new spaces constructively
    • don’t forget about the inbetween spaces and ask how you can support students freedom to engage in self-directed and independent learning outside the formally planned and tutor-directed activities

Innovative practices in education (colloquium)

Last week I attended a teaching and learning colloquium at Granger Bay, near the Waterfront. It was organised to showcase some of the teaching practices being used at the 4 teaching institutions in the Western Cape. I was fortunate to be invited to present one of the keynotes on Friday morning and since I’ve been thinking about PLE’s lately, that was the focus of my talk. Below you can see the graphical notes taken by Ian Barbour of the 2 keynotes of the conference.

Here are my notes from the 2 days.

Innovation through foundational provision and extended programmes: future trends, threats and opportunities (Professor Ian Scott)

It can’t go on with us doing “more of the same”.

Higher education is elitist, with a tiny proportion of the population being recycled through the system.

We are moving towards mass participation, with all the associated problems that this brings

Innovation = taking new approaches, doing things differently from the mainstream (creative solutions to problems)

The main difference between HEI that do well and those that don’t, is the attention of the institution (Carey, 2008). There is effort and professional accountability, systemic enquiry and research

Success = developing strong foundations and completing the qualification well. Not just about access. It’s dependant on complex issues e.g. teaching and learning approach, affective support, material resources

Future challenges in academic development:

  • Meeting the needs of the majority
  • Low participation and racially skewed
  • Poor and skewed graduation rate after 5 years = 30%
  • Under 5% of black youth succeeding in HE (unsustainable)
  • Makes little sense to continue on our current path, given the above stats

Who should extended programmes serve:

  • Mainstream students who are now failing or are dropping out for learning-related reasons
  • The majority of students who are not graduating in regulation time
  • But EP’s are reaching less than 15% of the intake, even though it’s a majority need (how can we justify the status quo?)

What can be done?

  • Extend the reach of EP’s in their present form, with a focus on improvement?
  • Move to a flexible curriculum framework with a 4 year degree as the core?
  • Can foundational provision be successful with limited student number, and if so, what are the limits?
  • How does this sit with the need for expanding the programmes?

If success is dependent on small numbers, we have a big problem

Institutional differentiation: Looked at stratifying HEI’s, but who would end up in the “bottom” levels. Moved towards “reconfiguring the institutional landscape” through mergers. But there is a danger of institutions losing their way, and not sticking to their mission. Is this a distraction from the central goal of producing more, good graduates?

Implications

Will differentiation lead to further polarisation of the student intake in terms of educational achievement? Because educational achievement is not potential, and is still polarised along racial, socio-economic lines.

Will there be pressure to remove EP’s from “research” universities? → which will result in less funding and educationally disadvantaged institutions becoming the “new mainstream”

Are these bad things?

To what extent can structural change, in itself, make a difference? Are there any alternatives?

Building student confidence through a class conference in an extended curriculum programme (Maryke Meerkotter)

Some students are resistant to the concept of evolution (in biology)!

Initially, 45 students split into groups and given topics for poster presentation. But it was too open.

Next year had more specific guidelines, with more focused topic (53 students), and individual talks about their own poster

This year, conference was very specific. 87 students, so much more structure was needed i.e. specific mammals were assigned to individual students. Questions had to be answered to prevent cut and paste.

Initial intent:

  • Relieve lecture stress
  • Students to engage with “irrelevant” content
  • Raise awareness of importance of course content
  • Allowed students to take ownership of the content, especially when assigned individual animals
  • Practice oral presentation
  • Exposed to poster making skills
  • To have fun trying something new

Initial scepticism and advice:

  • Doubt that it would succeed
  • Too much unnecessary work
  • Needs a good relationship with class, as lecturer should be confident that students can perform
  • Some envisioned chaos, so needed clear guidelines
  • Some advised no rewards, but students appreciated being acknowledged

Setting guidelines:

  • Holiday assignment
  • Written and verbal communication of assignment tasks
  • Guidelines about poster and oral presentations
  • “Computer literacy” = Powerpoint
  • Specific questions needed to answer in poster and presentation
  • Lecturer created a poster as an example, in subsequent years take the best examples of previous years
  • Provided rubrics for evaluation
  • Minimum requirements for posters, and not part of evaluation, so students who could afford more weren’t advantaged

Evaluation:

  • Oral presentations marked by lecturer and teaching assistant (reliability)
  • Audience tested at the end of each session (to ensure attendance of non-presenting students)
  • Posters were peer marked, using similar content as the marking group (each student marked 3 other posters anonymously)

Administration:

  • Assignment of topics
  • Find space for posters to be displayed
  • Due dates for posters to be mounted
  • Loading of oral presentations prior to talks (use email, caution with flash drives, time constraints)
  • Lecturer needs to listen and mark at the same time
  • Students were assigned posters to mark to avoid students marking their friends work

Empowers students to take ownership of course content, especially the “boring” courses. Recommended for small classes

Introducing concept mapping as a learning tool in Life Sciences (Suzanne Short and Judith Jurgens)

A lot of diversity in the course, in terms of student population

Some of the problems:

  • The gap between school and university
  • Testing of concepts reveals confusion
  • Basic concept knowledge is inadequate, lecturers want to make assumptions about what students come into the course with
  • Poor literacy levels for required university levels
  • Low levels of student success
  • Low pass rates
  • Unable to manage the large volume of content
  • Textbook content is “unfriendly”, not contextually relevant, language is inaccessible
  • Poor integration of knowledge
  • Don’t see how biology fits into scientific study
  • Don’t apply knowledge and strategies from other subjects, concepts are compartmentalised

Hay, Kinchin and Lygo-Baker (2008). Making learning happen: the role of concept mapping in higher education.

Concept map: an organising tool using labels to explain the relationship between concepts, the links making propositional statements of understanding. Can be interesting to see how different “experts” in the course see it differently. We need to first negotiate our shared understanding of the course before we can expect students to understand it.

Rationale:

  • To “deconstruct” faulty knowledge acquired at school and reconfigure it
  • Better grasp the relationship between all areas of study
  • Empower students with a learning and knowledge construction tool
  • Facilitate better use of the textbook

Don’t rely on one source

Facilitates textbook use:

  • overview of concepts and relationships
  • awareness of learning strategies
  • active use of resources
  • Assists with knowledge construction:
  • identified major concepts and links
  • identified gaps in school learning
  • useful as studying tool
  • knowledge construction can be individualised
  • Enables evaluation of student learning:
  • view of student understanding “at a glance”
  • encourage discussion of concepts and categorisation

Difficulties:

  • time consuming
  • high levels of collaboration between staff
  • not all student work visually / spatially
  • takes practice to do well

A genre based approach to teaching literacy in a university bridging course (Taryn Bernard)

How do structure a writing course to develop academic literacy, including other cognitive skills in the first year, among diverse student groups?

Students compartmentalise knowledge and find it hard to integrate into other courses. How can this be addressed?

Students want to feel as if they’re dealing with university-level content, and not high school content

Genre:

  • Text-type e.g. journal articles, books, essays
  • Abstract, goal orientated and socially recognised way of using language, limited by communicative purpose and formal properties
  • Social code of behaviour established between author and reader
  • “A term used for grouping texts together and representing how writers typically use language to respond to and construct texts for recurring situations”

Students need to be introduced to the “culture” of academic discourse

Genre-based pedagogy:

Student learning is affected not only by prior subject knowledge and by approaches to learning but also by the ability to deal with text genre (Francis & Hallam, 2000). An understanding of generic conventions increases success at university (Hewings & Hewings, 2001).

It’s important to validate prior knowledge, and many don’t see the purpose in academic discourse. Students sometimes feel it’s “too complex”

Quantitative literacy courses for humanities and law (Vera Frith)

UCT recognise information literacy as being an important graduate attribute

Quantitative information must be addressed in the disciplinary context

The more that content is embedded within a real-world context, the better

Students can be confused between focusing on the context, as opposed to the content e.g. placing emphasis on what they should be learning, with the contextual framework being used

The impact of horizontal integration of 2 foundation modules on first years knowledge, attitudes and skills (Martjie van Heusden and Dr. Alwyn Louw)

Earlier introduction to clinical placements have a significant influence on students professional development, especially in communication

Research assignments for first year med. students at SU:

  • Identify conditions
  • describe disorder
  • use correct referencing
  • submit to Turnitin with only 10% similarity allowed

Did knowledge improve? What about attitudes and motivation? Did it transfer to the 2nd year?

Research assignments contributed to improved student attitudes

Saw an improvement in writing and research skills

Assignments promoted self-esteem, increased background knowledge and allowed students to ask informed questions

Foundation matters: issues in a mathematics extended course

Important to be aware that students come into the course with mixed abilities, which affects how they perceive the course

Language support for communication skills of foundation Engineering students at CPUT (Marie-Anne Ogle)

Students ability to study is crippled by their lack of confidence in their ability to speak well

Problems:

  • Students don’t speak or hear English often
  • School teachers don’t give presentation training
  • Student lack self-esteem / confidence
  • Students don’t have an understanding of their own problems
  • Only 1 language lesson/week in a very crowded timetable

Rules:

  • Transparent goals
  • Everybody must talk
  • Students choose the subjects they want
  • Intensive reading programmes to support this
  • Students manage their own library
  • Students take over the class towards the end
  • Fun for self-motivation

“The limits of my language mean the limits of my world” (Ludwig Wittgenstein)

Use of clickers in Engineering teaching (Daniela Gachago and Dr. Mbiya Baudouin)

Useful because:

  • Results are anonymous, instant, recorded for later
  • helps to increase attention span, keeps students focused
  • Every opinion counts, not just the correct one
  • Works well with interactive learning and teaching style
  • Direct feedback about students conceptual understanding

Good feedback tool for students, identifies misconceptions instantly that can be addressed immediately, students also become aware that others have similar problems i.e. they’re not alone

Important to use equipment to stimulate discussion

Mazur sequence (see also this transcript of Mazur presenting on using technology to engage students, as well as this video presentation).

You can forget facts but you cannot forget understanding

Use of clickers must be must be accompanied by discussion

“The more a lecturer talks, the less a student understands”

Students enjoy the experience of using new tools in class, very positive response, but they do need a short introduction

Challenges:

  • System takes time to set up, and technical troubleshooting not always easy
  • Can waste time
  • Questions need to be changed often
  • Type of question asked needs to change
  • Can have “clicker fatigue”

Using clickers as a tool in classroom instruction to facilitate student learning (Mark Herbert)

Focus not on what student don’t know, but what they require to develop into successful practitioners of the discourse

Students exposed to how knowledge is constructed, structured and communicated

Lecturers facilitate student learning

Students must prepare for lectures (but do they?)

Constructive feedback given regularly and as soon as possible

Class attendance improved

Student interaction can stimulate learning. Students will often find the correct answer when discussing among themselves, without lecturer involvement

Student confidence increased as a result of using clickers

Innovative pedagogical practices using technology: my personal journey (Ingrid Mostert)

Blended learning model for ACE in mathematics

Bulk SMS (e.g. Frontline)

Off-campus access can be hampered with slow loading times, different to intranet

Someone else has already solved the problems that I have. The more people who know about my problem, the quicker it’ll get solved.

Moodle has a module for mobile access, which allows students to participate in forum discussions through a mobile interface

Can use mobile tech to conduct surveys. Is there a cost for students? Yes, but it’s minimal relative to SMS

Sharing experiences make the load lighter

Exploring the extent to which clickers enable effective student engagement (Somikazi Deyi, Edwine Simon and Amanda Morris)

Use real world events / contexts to make coursework relevant. What is important to students? Use that as a scaffolding for the course content

Planning is important

Students engage more deeply with complex questions. We should challenge them and raise our expectations of what they’re capable of

Difficult to draw conclusions after one session. Need to follow trends over time

Realise that other people have different perspectives and world views

Try group voting as opposed to individual voting

Curriculum development and PhD

Earlier this week we had our second curriculum development meeting in our department. It’s something we’ve recently implemented after realising that we need to pay more attention to teaching and learning, especially now that the university’s released it’s implementation plan for the next 5 years.

After going through one of the modules, we quickly realised that in order to really understand the relationships between modules, we’d need to look at them in 2 different ways:

  • Horizontally – how do concepts in different “groups” relate to each other in the same year of study? E.g. what are students learning in anatomy and how does that relate to their applied subjects?
  • Vertically – how do concepts in the same “groups” relate to each other over time? E.g. how does what students learn in PHT203 relate to what they learn in PHT303?
  • It’s hard to visualise how these different “tracks” relate to each other. I’m thinking that a concept mapping tool (e.g. Cmap, Xmind) would be the best way to do it.

We’ve split the curriculum into “groups” of related modules e.g. Movement Science (human movement and movement disorders), Applied physiotherapy (clinical theory), Clinical practice (application of theory). Staff members were then assigned to groups to look at the following over the next few weeks:

  • Curriculum alignment. We’ll need to make sure that our learning outcomes are aligned with content, and assessment
  • Practical assessment. We’re looking at moving to our practical assessments to an OSCE-type format
  • Integration of teaching and learning practices in alignment with university policy
  • Determine how we’re going to integrate the institutional graduate attributes (scholarship, lifelong learning, etc.) into our modules and teaching practice

During the meeting we noted other issues that arose. We realised that we have no naming convention for our digital files, which means they all have different names. I’d like to see a convention adopted during this process e.g. module code-description-version-increment. I also think we should consider having a Notes section at the end of each module descriptor, where we can document minor editorial corrections that happen during the year, as opposed to creating a new version for major changes and archiving the old one.

I’ll be sitting in on each group to document the process we’re going through. Part of my PhD will be how I track the changes that are happening in the department, both as a result of my own work, but also as we fall in line with institutional changes in teaching and learning. I don’t see this becoming part of my publications, but will rather form bridging documents that establish relationships between research objectives. I’ll need to evaluate the process of the project, and these meetings will form an important part of the process. I’m starting to realise that the curriculum we had when this project began will be quite different from the one that exists when it ends.

Students’ languages and their associations

Our Directorate of Teaching and Learning has organised a series of seminars over the next few months, with invited speakers from a variety of institutions across the country. They’ll be presenting on a range of topics, including academic literacy, integrating technology into teaching, working with large classes, teaching practices, and educational theory. I’ll also be presenting a session on personal learning, which will be similar to the other talks I’ve give on the topic recently.

Today we had a presentation by Doctor Brenda Leibowitz, who spoke about the relationship between language and biography / identity and their impact on teaching and learning. Here are a few short notes I took during the session.

Language studies typically look at homogeneous groups, but few look at cross-institutional and cultural communities.

Language can be intimidating for students (“the words are so complicated”), which means that texts can take longer to read, result in more guessing and reduced coherence

“Too hard to find the words, so you just make simple sentences”

Students appreciated the focus groups where someone was paying attention to their difficulties (“This gathering is like rain in the desert”)

The ability to communicate effectively depends on genre. Context has implications for language

Attitude has implications for language, as does identity

Mastery of a second language is important, but is not the sole determinant of academic success

Role of language in teaching and learning:

  • Proficiency
  • Social – and isolation
  • Utility
  • Value (exposure)
  • Ideological associations

Language has an impact on social and organisational structure

Code switching

How can we introduce students to the genre of academic discourse?

Talking and writing students into the discipline”. How do you take your students with you to the conclusion, rather than leave them behind and create a gap that they cannot cross?

Thoughts on social networking with 3rd year physio students

Earlier this week I ran a workshop with our 3rd year physio students, as part of my SAFRI project where I’m looking at how participation in a social network can impact reflective learning practices in a community. Unlike the other workshops I’ve run, I’m going to be running this assignment, which will see the students posting 2 reflective pieces based on ethical dilemmas they’ve experienced while on their clinical placements. I was struck by a few thoughts as I was going over some of the activity I observed both during and after the workshop.

This group is by far the most technologically sophisticated group I’ve run the workshop to date. As we were setting up their profile pages, some of the students were logging into their Facebook accounts to pull in those photos to add to our social network. Most of what I was explaining wasn’t new, and even for those who have no experience with any other social networks, they caught on pretty quickly.

I learned that at least one of them enjoys photography, and not only enjoys it but shares his fantastic pictures on Tumblr. I would probably never have learned that about him if it wasn’t for this little experiment of mine. I think that that’s one of the enormous benefits of social networks…that we might actually engage with students in ways that would never come up in class. I mean, how many times do we ask students what their hobbies are? And even if we do, and they choose to mention it, will it ever match up to being able to see it? After exploring some of the photos from this student, I came across one of his short posts, which is one of the most inspiring things I’ve read in a while.

It was quite exciting for me not to have to listen to any moaning when I introduced this assignment. I also haven’t read anything negative about either the assignment or the network, which is refreshing. I did have one student report that the “workshop sucked”, although he hasn’t yet responded to my request for any suggestions for improvement. We still have issues with some of them not having computer or internet access at home, but I think that being on campus for at least a short while during the week is enough time to participate.

I have one more workshop to do with the first year students, which I’m hoping to finish sometime next week. Then it’s just a case of waiting for the assignments to finish running, survey the students to determine their experiences using the network, and finally to analyse their activity to see if there was any reflection / community building going on. I’m going to actively facilitate this group, as opposed to the relatively passive stance that other lecturers took when their assignments were running. I’m interested in seeing if this group has a better experience with active facilitation, as opposed to just being left to their own devices.

Reflections on SAAHE 2010

The SAAHE conference has come and gone for the 3rd year running. It’s been an interesting and engaging 3 days, and since I’ve already posted all my notes, these are just a few thoughts on what it’s like having a conference in South Africa. And it’s the last post, I promise.

To get the negative stuff out of the way, there were two things that really disappointed me, and which I’ve mentioned at every conference I’ve been to (in South Africa), and they are:

  • A lack of dedicated wireless access, even though internet access is not an issue at tertiary educational issue
  • No video or audio coverage of any of the tracks, not even of the keynote speakers (I’m sorry, but uploading presentations just doesn’t cut it)

As a collection of South African health educators who say they to participate in a global, regional and national conversation on these issues, how can you possibly do it if you have no voice? I can’t think of any reason not to provide dedicated access in all conference venues.

Piggy backing on this idea of what we could do with access, I had an interesting conversation with a colleague when we were trying to decide which presentations to attend. We realised that we were trying to situate our own work within the broader context of what was happening at the conference. Where does my work fit in with all the other work that’s being done in my own (or a similar) domain?

It seems to make sense that if all attendees (or a significant proportion) were tweeting, blogging, waving or otherwise engaged in providing their own personal experiences, perceptions, insights, etc., we would have multiple streams within which we would be able to situate our own work. Not that we would necessarily watch the streams while presenting (although that would be an option), but it would be nice to reference the work of others that you’d already seen in the stream. These referrals could be aggregated after the conference to see who’s working on similar ideas (or who should be working on similar ideas) and make it easier to build national networks for collaboration. What topics are most common? Who seems to be involved in the most conversations? Who are the “qualitative” people who can give me the insight I need for my own work?

Unfortunately, this won’t happen anytime soon. It’s not a technical problem (all the infrastructure and technology is there), but rather the complex human component. Besides a resistance to learn new things (“I’m a busy person, I don’t have the time”), most health educators aren’t technically savvy.

Finally, during the last half of the last day, we had a power outage across the campus and we had to continue outside. Interestingly, most people seemed quite amused with the experience. We got to sit outside and enjoy the beautiful weather and have a more informal (if a bit rushed) discussion. It was also refreshing for me having to present my work without a presentation on a computer. I felt a bit more connected with the audience, although being in such close proximity could also be a bit daunting. See below for our “conference venue”.

All in all, it was a great conference, I learned a lot and the organisers should be proud of what they achieved.

SAAHE – Social networks and reflective practice in clinical education

Here is my presentation from the SAAHE conference.

SAAHE workshop – Curricular alignment. What does it mean?

Presented by Professor Debbie Murdoch-Eaton.

If you don’t know where you’re going, you’re probably not going to get there. A clear vision of the intended outcomes should drive every aspect of teaching, learning and assessment

Outcomes must be clear because they will determine your teaching methods, and will also direct assessment

Preparing students for their final assessments should be very similar to what they will be doing when they graduate i.e. what the students are focussing on in their final weeks of being a student, should be very much like what they will do in their first jobs

Recent teaching activity (groupwork exercise). Do you:

  • Teach what students needed to know
  • Teach for assessment
  • Give facts
  • Consider how you will teach the class?

What sort of learning does your assessment generate?

Miller’s pyramid. What is the level you’re trying to teach at?

3P model of learning:

  • Presage – the “raw materials” you start with. Students e.g. background, culture, literacy, motivations, language, experience, expectations, gender i.e. know your learners’ variables. Learning environment / teachers – resources, experience, background, structure i.e. what is the educational climate? What sort of tasks are appropriate for these variables?
  • Process of learning – How can this be structured so that it will generate…
  • Product – learning outcomes (facts, skills, structure, transferability) relate back to Miller’s pyramid

Another groupwork exercise – Choose 1 competency from a teaching session you are responsible for. Plan how you would ensure that outcome would be met, considering these aspects:

  • Student/environment
  • Methods of teaching
  • Appropriate assessment

SAAHE – short oral presentations

Assessment challenges in UG medical education (GG Mokane)

Medical school in Botswana is spiral, integrated, community based and problem-based, but the rest of the university is didactic

Format, content, timing and feedback are important components of assessment

Assessment in this course has an emphasis on 3 types of MCQ’s

  1. Matching
  2. Single best answer
  3. True/false (multiple answer) – study was based on evaluating this specific format

How should these questions be used, and what instructions issued when they are?

Retrospective analysis of students performance in cumulative and non-cumulative formative assessment methods (AA Adebesin)

If students consistently score above 60%, they are exempt from the final summative exam (university rule). This had implicit problems in that students couldn’t graduate with distinction because they scored high enough to not write the summative exam.

Introduced a cumulative assessment process that carried formative assessment marks over from block to block

How do you objectively measure student progress and understanding?

A student portfolio: the golden key to reflective, experiential and evidence-based learning (G Muubuke)

Portfolios are useful evidence of learning and reflective processes

Logbooks are not good indicators of learning

Portfolio content included bio-data, radiological images, critical learning incident, clinical evaluation forms, logbook – with guiding questions to assist reflection

Portfolio assessed formatively and summatively

Found initially that students and teachers had only limited knowledge of portfolios, although training workshops helped in this regard

Stakeholders welcomed the introduction of the tool

Assessment whittled down to 2 items, rather than whole portfolio (1 item selected by student, the other by the teacher)

Students learn and develop by reflecting on experiences

Unfair to judge learning based only on exam marks

Students should see portfolio management as on ongoing practice, and not just a “task” to be completed

The purpose of the portfolio must be defined at the outset (i.e. what is the benefit to the student?), and it should be simple to complete, students should not see it as additional work

It should be aligned with institutional goals and learning activities

There’s a lot of effort and time involved in assessing portfolios, and rubrics may help to assist marking (adds standardisation)

Making assessment matter: does a novel model of the pre-assessment effects of summative assessment on learning also operate in clinical contexts? (F Cilliers)

There is little evidence of what the impact of assessment is on learning, as well as the mechanism of the impact

Validating a model by looking at the following 4 factors:

  • Explanatory power
  • Generalisability
  • Integration
  • Utility

Daily exposure to consequences leads to evenly distributed learning in clinical settings, but in theory modules, periodic assessment would lead to “binge learning”. However, the more relaxed nature of the clinical (evenly distributed) model might actually lead to the binge-type learning model of theory blocks.

Relaxed environments allow students to go and follow up on work after the situation, but stressful environments force students to memorise content that they forget immediately afterwards

High risk environments lead to surface cognitive processing strategies, as opposed to supportive and low risk environments leading to deeper cognitive processing

The model is useful for explaining behaviour, is generalisable, and is integrated. Not able to determine if it is useful yet

It’s about personal and academic consequences (and their imminence), not just the act of assessment. When block marks are given to students at the end of a block, that were relevant to a situation that occurred during the block, students are less likely to pay attention to the feedback (in whatever form it takes). Consequences should be immediate and not scary.

Assessors can have a powerful (and potentially negative) influence on learning

Students study more for stressful situations, but they remember less. They study less for relaxed environments, but are more likely to follow up on the situations and remember more

SAAHE keynote – How to construct a medical curriculum that matters

Presentation by Professor Herman von Rossum.

In preclinical years, you insert learning stimuli from the context of application (i.e. a clinical environment) into the educational learning environment. In clinical years, you insert education moments into the healthcare environment

In constructing a curriculum, you must first determine the health needs of a society, then determine the tasks of the doctors. From the tasks, what are the required competencies (knowledge, skills, behaviour) → final requirements of the programme

students → metamorphosis → doctor → fills health needs of society

Curriculum philosophy:

  • Competency orientated
  • Task driven
  • Learning in context
  • Teaching facilitates the learning
  • Assessment guides the learner and evaluates the outcome

Medical curricula have evolved over time:

  • Discipline or system based, (knowledge of teachers define content)
  • Thematic or integrated (teachers co-ordinated and optimised content for students)
  • Problem solving / skills lab (learning process of student became the issue)
  • Patient used as stimulus for learning moments, hybrid programmes (what is the right mix?)
  • Outcome orientated, learning in context, healthcare learning environment (competencies and learning stimuli in relevant context)

How do you translate the philosophy and structure / framework into a programme? Define the programme (e.g. CanMEDS, Tomorrows Doctors) using a blueprint determined by authority (final outcome is a legal guideline)

How do you design the learning path? Should view the pathway at a macro level (the course or the degree), a meso level (semesters), and micro level (weekly, educational structures) → real patients are introduced into the learning process at the basic structural level, and used as context for exploring concepts during that week. This would be a major challenge for us, without a link to a teaching hospital.

What “tasks in practice” (theory and practical) can be formulated from the clinical conditions, competencies and concepts involved?

One of the major differences in medical education compared to our curriculum is that the doctors can implement curricular activity directly on the wards. We can’t pull students off block to attend to these issues.

Hard concepts are “developed in dialogue” between students and clinicians

Learning rhythm: stimuli (patient introduction) → learning (engagement with patient and colleagues) → reflection on the process (in tutorials with roles rotating between students)

How do you develop a narrative between teachers and clinicians to construct learning tasks with patients? Involves meeting with patients and family to construct the problem, and content cleared with stakeholders (informed consent).

In addition to working through the actual problem-based case, the staff also provide students with a list of questions specific to the condition, that require them to follow up and in some cases, make personal reflections on the narrative.

How can you insert an educational moment in a healthcare setting? Apparently the healthcare setting must be “transformed” into an educational setting. How do you do this?

How do you select suitable healthcare events (intake, intervention, follow-up, discharge) to transform into an educational moment? What can be learned at each of these events? How do you lead one educational moment into the next?

We need to think long and hard about a better integration of clinical practice / events into our curriculum. We do suffer from the lack of partnership with a teaching hospital and having ready access to patients. How can this be addressed?