Tag: bias

ChatGPT won’t be your doctor

Sep 30, 2024

in AI, Health

AMIE, bias, ChatGPT, clinical reasoning, diagnostic AI, Google, hallucination, harm, healthcare, medical ai, medical decision making, medical diagnosis

Commercial frontier AI models like ChatGPT and Llama are known to hallucinate, but research proving this is redundant. Instead, attention should be on specialised medical AI systems like Google’s AMIE, which are showing impressive improvements in diagnostic accuracy. These purpose-built models, not general-purpose language models, are likely to be integrated into healthcare products.
Weekly digest 23

Jun 8, 2024

in Digest

bias, decision-making, design, Milky Way, openai, reasoning, software, space, user interface

A weekly collection of things I found interesting, thought-provoking, or inspiring. It’s almost always about higher education, mostly technology, and usually AI-related.
BIP AI – AI for organisation and communication

May 13, 2024

in AI, Presentation, Productivity

artificial intelligence, bias, BIP, Blended Intensive Programme, communication, effectiveness, hallucination, note-taking, organisation, personal productivity, professional productivity, prompt framework, virtual assistant, workflow

In this workshop for the Blended Intensive Programme on AI in education and research, Antonio Lopes, Hugo Santos and I explore the transformative potential of integrating generative AI into personal and professional workflows for academics. Practical use cases demonstrate how AI can streamline tasks, from constructing lecture outlines to drafting emails. The workshop provides a…
BIP AI – AI in research: Opportunities and challenges

May 6, 2024

in AI, Presentation, Research

academic integrity, artificial intelligence, bias, BIP, Blended Intensive Programme, Data analysis, ethics, expertise, hallucination, literature review, research assistant, research methods, summarisation

In this Blended Intensive Programme on AI, Guillem Jabardo and I explore the potential of generative AI to support all stages of the research process. However, while extremely powerful, these tools still have limitations, necessitating critical review. The ability of generative AI to augment human cognition represents a paradigm shift for academia.
Stop using AI detection services because they don’t work

Mar 11, 2024

in AI, Assessment

AI detection, bias, ChatGPT, cheating, discrimination, openai, turnitin

The researchers conclude that the available detection tools are neither accurate nor reliable and have a main bias towards classifying the output as human-written rather than detecting AI-generated text. Furthermore, content obfuscation techniques significantly worsen the performance of tools. Weber-Wulff, et al. (2023). Testing of detection tools for AI-generated text. International Journal for Educational Integrity,…
My biased enthusiasm for generative AI, clearly articulated

Dec 16, 2023

in AI

bias, foundation models, language models, large language models, LLMs, mass education, open source, philosophy, values

I understand the serious ethical concerns many have raised about generative AI. These are important issues that deserve thoughtful debate. I believe that I know something about these concerns and I know the critical position I’m meant to take as an academic working at the intersection of education and technology. I’ve spent 15 years in…
Workshopping AI in higher education with students

Dec 12, 2023

in AI, Education, Students, Workshop

accessibility, bias, ethics, higher education, prompt, student-led, students, workshop

I’m thinking about contributing to a workshop activity that involves students working on practical issues related to the implementation of AI-based services in higher education. Here are some ideas that I think might be worth exploring.
Generative AI is useful

Dec 9, 2023

in AI

bias, black box, Claude, electricity, ethics, expensive, hallucination, transparency

Generative AI is useful, in the same way that electricity is useful. I use Claude for a wide range of tasks, every day. And today is the worst that Claude will ever be. Claude – and other generative AI services – will never ever again be as crap as it is today. Make no mistake,…
Will all public understanding be shaped by the biases of AI?

Nov 12, 2023

in AI, Note

Amusing Ourselves to Death, artificial intelligence, bias, epistemology, Neil Postman, television, TV

In Amusing ourselves to death (1985), Neil Postman wrote: “We are by now well into a second generation of children for whom television has been their first and most accessible teacher and, for many, their most reliable companion and friend. To put it plainly, television is the command center of the new epistemology. There is…
ChatGPT is – and isn’t – a good psychotherapist

Oct 25, 2023

in AI, Clinical

bias, ChatGPT, depression, medication, mental health, psychotherapy

First, a caveat. I know that ‘psychotherapy’ and ‘doctors treating depression’ aren’t the same thing, so this isn’t a direct comparison. However, it’s worth noting that few people are going to make the distinction. They’re going to see conflicting articles about ChatGPT being good – and bad – for ‘mental health related stuff’, and find…
Link: ChatGPT outperforms doctors in depression recommendations

Oct 22, 2023

in AI, Clinical, Note

bias, chatbot, ChatGPT, depression, doctors, medication, psychotherapy, recommendations, unbiased

Schreiner, M. (2023). ChatGPT outperforms human doctors in unbiased depression treatment recommendations. THE DECODER. “…for mild depression, ChatGPT recommended psychotherapy without medication by the majority, in line with clinical guidelines. In contrast, only 4.3% of primary care physicians recommended psychotherapy and were more likely to prescribe medication. For major depression, ChatGPT recommended a combined approach…
Link: OpenAI’s Guide to Teaching with AI

Sep 14, 2023

in AI, Note

ai, artificial intelligence, assessment, bias, ChatGPT, critical thinking, debate, openai, teaching, translation, tutor

https://openai.com/blog/teaching-with-ai “We’re sharing a few stories of how educators are using ChatGPT to accelerate student learning and some prompts to help educators get started with the tool. In addition to the examples below, our new FAQ contains additional resources from leading education organizations on how to teach with and about AI, examples of new AI-powered…
Language model hallucination can still be accurate

Jul 20, 2023

in AI

Anthropic, bias, Claude, confirmation bias, fact, largue language model, links, LLM, source, truth

I wanted to test if Claude AI could read and summarise an article when only given a URL. According to the response from the model, Claude can’t visit links. However, its summary of the article at the URL is spot on. Like, really good. So either Claude is lying and can visit links, or it’s…
Weekly digest (05-11 Jun 2023)

Jun 11, 2023

in AI, Digest, Education, Research, Technology

algorithms, Allen Institute, bias, black box algorithms, collaborative writing, conversational framework, diana laurillard, Espanso, etherpad, Google Docs, hypocrisy, learning design, machine learning, semantic learning, stochastic parrot, text expander, trust

AI bias and block boxes I’m getting tired of reading about bias and the black box nature of AI (even though I’ve been guilty of this myself). Human brains are biased. Human brains are block boxes. We still trust the outputs of human brains. I’m not suggesting that we just start trusting algorithms. But I…
Reliance on automated systems…

May 12, 2023

in AI, Note

automation, bias
Weekly digest (01-07 May 2023)

May 7, 2023

in AI, Digest

AI relationship, AI tutor, bias, connection, Her, hype cycle, interaction, language model, paradigm, social interaction, tutor, tutorial, user interface, worldview

Opening up, or closing down, your optionsI don’t remember if I saw this list somewhere, or if I made it up. I’ve come across the following ways of thinking about generative AI and language models in higher education and professional practice: My initial thought was that this feels almost like a progression through stages (maybe…
Fixing algorithms isn’t going to fix society

May 6, 2023

in AI

algorithmic bias, artificial intelligence, bias, racism, sexism, social, society

I keep seeing articles reporting that AI is biased, and exhorting software developers and private companies to do more to ensure that algorithmic bias is stamped out. But I don’t see any of those people asking for human bias to be stamped out. Which is weird, because human bias is the ultimate cause of algorithmic…
Bias in machine learning may be a Good Thing

Aug 9, 2021

in AI

bias, human bias, machine learning, machine learning bias, ml model, social bias, society

I get that this this is probably a controversial position to take but I’m going to suggest that bias in machine learning (ML) models may be a Good Thing. But first, I need to ask – again – why everyone piles onto bias in machine learning but they’re quite content to give human beings a…
Weekly digest (14-18 Jun 2021)

Jun 18, 2021

in AI, Digest, Research

algorithm, artificial intelligence, AutoML, bias, book, chip design, GPU, literature review, machine learning, publication, science fiction, Tensorflow, transfer learning, wicked problem

This digest has an AI and machine learning focus because I’m preparing a presentation for the SAAHE conference next week, and my topic is Clinicians’ perceptions of the introduction of AI into clinical practice. It’s from an international survey I completed in 2019, mostly forgot about in 2020 (because, Covid) and am finally trying to…
Podcast: Clinicians’ ‘Number-One Wish’ for Artificial Intelligence

Feb 13, 2020

in AI, Clinical

bias, clinical ai, ICU, intensive care unit, machine learning, podcast, topol

…we installed cheap depth sensors that can collect human behavior data on patients and clinicians without infringing on their privacy, because these are not photo grabs of people’s faces and identities. With that information, we can observe longitudinally, 24/7, whether proper care is being given to our patients and provide feedback in the health delivery…