Tag: large language model
-
My thoughts on the different generative AI tools I’m using
TL;DR Here are is my ranked list of suggestions, based on my own experiences and use-cases: Over the past year or so, I’ve been experimenting with a few different language models and image generators. Over time, I narrowed in on Claude, and wrote about my preference for using it over other options. A couple of…
-
OpenChat is an open-source language model
in AIOpenChat is an open-source large language model being developed by a student team at Tsinghua University in China. In Dec 2023, OpenChat was GPT-3.5 equivalent, outperforming ChatGPT (Mar 2023) in some benchmarks i.e. the free version of ChatGPT, not ChatGPT Plus which is running GPT-4. Despite our simple approach, we are committed to developing a…
-
Follow-up prompts to generative AI responses
If your initial prompt isn’t specific enough, generative AI / Large Language Models can sometimes make assumptions about your level of understanding of the problem. In these cases, it can sometimes feel like you’ve hit a barrier because the response to your original question or instruction may not be helpful. In these cases you need…
-
AI and expertise in professional education – ADAPT conference
At the 2023 ADAPT physiotherapy conference, I discussed the impact of generative AI on physiotherapy education, emphasising how it challenges the traditional role of universities in professional training by offering accessible and personalised expertise. The presentation highlighted AI’s potential to democratise learning, enhance project-based education, and create affordable learning alternatives outside formal degree programs. I…
-
What would Claude do?
Here’s another example of a different way to think about language models: ask it for concrete advice when you’re faced with a difficult decision. In particular, the kinds of decisions that need to integrate lots of context, many variables, with high levels of uncertainty, and high-stakes outcomes. The kinds of decisions that, even with the…
-
An AI-supported health professions tutor (and a brief comparison with Claude)
https://hpe-bot.com/ Update: For more information about the additional functionality of this bot, see this LinkedIn post by Lambert Schuwirth. The interface is a bit basic, and I haven’t played around with it much, but it seems to do a decent job with the kinds of questions I asked. Also, the premium account seems to offer…
-
Claude, help me to write
Yesterday I published a post describing my concerns with how universities are responding to the new paradigm of expertise-on-demand that’s facilitated by generative AI. At the end of that post I noted that I wrote it collaboratively with Claude, and this post describes what that process (kind-of) looked like. I also want to be clear…
-
When an unstoppable force meets an immovable object
TL;DR (generated by Claude, lightly edited by me). The rise of abundant expertise in the form of generative AI questions the university monopoly on expertise provision and validation. Leadership in the creative deployment of AI for learning, teaching, and assessment will require a change in mindset and a shift towards a new paradigm, which universities…
-
Using LLMs to raise our expectations
Instead of spending so much of our time thinking about whether students 1) should use LLMs, 2) how much they use it, and 3) what they use it for, let’s just say that they should use it, a lot (IMO, the more, the better), and look more closely at what they use it for, and…
-
I tell my students to use language models to replace me
in AII know there’s a lot of concern about the potential issue of using LLMs like ChatGPT and Claude to write essays. And it’s true that there’s a risk they can be used for this. But I worry that we’re placing too much emphasis on a risk that I think largely misses the point, which is…
-
Claude, help me choose a career
Most people on the planet will need to make a series of decisions about how they are going to earn a living. And most people lack the networks and access to expertise to help inform those decisions in the best way. You might end up in a career because of social pressure, lack of opportunity,…
-
Use language models to explore a space of possibilities
Strong E, DiGiammarino A, Weng Y, et al. Chatbot vs Medical Student Performance on Free-Response Clinical Reasoning Examinations. JAMA Intern Med. Published online July 17, 2023. doi:10.1001/jamainternmed.2023.2909 A popular chatbot is an interface for the generative pretrained transformer (GPT) large language model artificial intelligence (AI) system that generates humanlike text in response to user input.…
-
User guide for Claude AI
This user guide for Claude is an excellent resource, not only for understanding how you can use Claude more effectively, but for understanding language models in general. There’s an introduction, sections on prompt design and useful hacks to improve Claude’s responses, and an overview of the use cases you might consider for Claude. It also…
-
Article: CORE-GPT: Combining Open Access research and large language models for credible, trustworthy question answering
Pride, D., Cancellieri, M., & Knoth, P. (2023). CORE-GPT: Combining Open Access research and large language models for credible, trustworthy question answering (arXiv:2307.04683). arXiv. http://arxiv.org/abs/2307.04683 In this paper, we present CORE-GPT, a novel question answering platform that combines GPT-based language models and more than 32 million full-text open access scientific articles from CORE. We first…
-
Article: Towards Expert-Level Medical Question Answering with Large Language Models
Singhal, K., et al. (2023). Towards Expert-Level Medical Question Answering with Large Language Models (arXiv:2305.09617). arXiv. From the abstract: We performed detailed human evaluations on long-form questions along multiple axes relevant to clinical applications. In pairwise comparative ranking of 1066 consumer medical questions, physicians preferred Med-PaLM 2 answers to those produced by physicians on eight…
-
In Beta podcast on generative AI and assessment
It’s been a long time since Ben and I sat down to record something for the In Beta podcast, but I think this episode on Generative AI is a good one. As usual, Ben asks some great questions that really push me to think about what I’m thinking. This was a wide-ranging conversation that explored…
-
Generative AI in higher education: Paradigm shifts in assessment – Cape Peninsula University of Technology symposium
accountability, ai, artificial intelligence, assessment, assessment concerns, assessment design, assessment paradigm, assessment task, assessment validity, faculty development, higher education, large language model, learning inference, LLM, paradigm shift, pedagogy, standard assessment paradigm, universal anything machineIn this presentation at the Cape Peninsula University of Technology, I examines the impact of large language models (LLMs) on assessment practices in professional education. I critique the standard assessment paradigm and suggest that AI could reshape assessment methods. The presentation also briefly covers a faculty development framework and broader implications of AI in learning.
-
Bing allows you to modulate the amount of ‘hallucination’ in your response
Last week I wrote about LLM hallucinations, and how this isn’t the problem that everyone thinks it is. “I expect that soon we’ll see language models with features that allow us to modulate the output in some way. We may want to dial up creativity or serendipity, in which case we’ll see less overlap with…
-
Language models don’t sometimes hallucinate. They always hallucinate.
By now, most people have come across the issue of language models like GPT hallucinating, where the model generates an output that’s unrelated to the prompt. Or, you may find that the generated responses increasingly diverge from the topic (as the error rate in the model accumulates over increasingly long sessions). When the response generated…