Teaching should be full of ideas instead of stuffed with facts. – John Dewey
7 links for the week ahead
- Jill Barshay (2024-09-16). An AI Tutor Helped Harvard Students Learn More Physics in Less Time.
- Donald Clark (2024-09-13). Has ChatGPTo1 Just Stolen ‘Critical Thinking’ From Humans?.
- Laura Czerniewicz (2024-09-14). I Have Been Hallucinated!.
- Paul Graham (2024-03-10). The Best Essay.
- Zvi Mowshowitz (2024-09-16). GPT-4o1.
- James O’Donnell (2024-09-17). Why OpenAI’s New Model Is Such a Big Deal.
- Kaitlyn Tiffany (2021-08-31). Maybe You Missed It, but the Internet ‘Died’ Five Years Ago.
Creating clinical assessment items with language models
Lam, G., et al. (2024). Utility of large language models for creating clinical assessment items. Medical Teacher, 1–5.
To compare student performance, examiner perceptions and cost of GPT-assisted (generative pretrained transformer-assisted) clinical and professional skills assessment (CPSAs) items against items created using standard methods. We conducted a prospective, controlled, double-blinded comparison of CPSA items developed using GPT-assistance with those created through standard methods… There was no statistically significant difference in item difficulty, or discriminative ability between GPT-assisted and standard items… GPT-assistance resulted in significant labour cost savings, with a mean reduction of 57% (880 GBP) in labour cost per case when compared to standard case drafting methods. GPT-assistance can create CPSA items of comparable quality with significantly less cost when compared to standard methods.
OpenAI O1: ChatGPT Supercharged!
Personal update
- My latest Head space newsletter seems to have struck a chord with colleagues, which makes me happy.
- I’ve completed the lectures for the Physiopedia MOOC on generative AI in physiotherapy, which will run during Oct and Nov this year. The Physiopedia team will now do the difficult work of creating a course from the resources.
- Drafted an outline of a ‘standards of proficiency’ guidance document for integrating AI into physiotherapy practice, and shared with colleagues for input.
- Giving feedback on a PhD student thesis.
- Finalised preparation for a PhD viva in Norway (late Nov).
- Decided to initiate the development of a Simulated Placement framework for our school. Will work with our SIG to draft an evidence-based description of what simulated placement looks like for us.
- I’ve been thinking of creating a ‘digital health’ course that sits alongside our existing programmes in the school, which colleagues could draw from to inform their teaching. This idea feels like it’s moving closer to a point where I commit to creating it.
- Finalising travel arrangements to present a workshop at SUPSI in Lugano (Switzerland) in the middle of Oct.
- Finalised travel arrangements to Goa (India) for the 2024 Scientifica conference, to give a keynote address on AI in physiotherapy.