Tag: accuracy
-
Being inaccurate isn’t the same as being useless
New research on AI model factual accuracy shows that while language models struggle with certain difficult questions, this doesn’t diminish their value as thinking partners. Like human conversations, where perfect accuracy isn’t required for productive discussion, AI’s occasional inaccuracies don’t prevent it from being a useful collaborative tool.
-
Don’t sugar coat it
A prompt to get potentially more accurate (and also more concerning) responses from ChatGPT.
-
More to AI detection than accuracy
AI text detectors, like OpenAI’s 99.9% accurate tool, aren’t the solution to academic cheating. These detectors have limitations, including model-specific detection and manipulable statistical features. We’re not going to find answers by entering into an arms race with students, by trying to build increasingly accurate AI detectors.
-
People aren’t going to fact-check AI
Breakstone, J., Smith, M., Wineburg, S., Rapaport, A., Carle, J., Garland, M., & Saavedra, A. (2021). Students’ Civic Online Reasoning: A National Portrait. Educational Researcher, 50(8), 505–515. doi: 10.3102/0013189X211017495 Note that this paper was published in 2021. “Asked to investigate a site claiming to “disseminate factual reports” on climate science, 96% never learned about the…
-
Using Perplexity to find the source of a quote
I just used Perplexity to solve a problem that was doing my head in. I wanted to find the source of a popular quote by an author named Shannon Hale. The problem is that the quote is reproduced on hundreds of sites, and all the sites I tried (using Google and DuckDuckGo) didn’t provide the…