Tag: peer review
-
Weekly digest 46
A weekly collection of things I found interesting, thought-provoking, or inspiring. It’s almost always about higher education, mostly technology, and usually AI-related.
-
Weekly digest 45
A weekly collection of things I found interesting, thought-provoking, or inspiring. It’s almost always about higher education, mostly technology, and usually AI-related.
-
Weekly digest 43
A weekly collection of things I found interesting, thought-provoking, or inspiring. It’s almost always about higher education, mostly technology, and usually AI-related.
-
Link: The Latest “Crisis” — Is the Research Literature Overrun with ChatGPT- and LLM-generated Articles?
https://scholarlykitchen.sspnet.org/2024/03/20/the-latest-crisis-is-the-research-literature-overrun-with-chatgpt-and-llm-generated-articles/ “Elsevier has been under the spotlight this month for publishing a paper that contains a clearly ChatGPT-written portion of its introduction. The first sentence of the paper’s Introduction reads, “Certainly, here is a possible introduction for your topic:…” To date, the article remains unchanged, and unretracted.“
-
Claude, help me to write
Yesterday I published a post describing my concerns with how universities are responding to the new paradigm of expertise-on-demand that’s facilitated by generative AI. At the end of that post I noted that I wrote it collaboratively with Claude, and this post describes what that process (kind-of) looked like. I also want to be clear…
-
A trilogy of posts on using AI for academic articles
Earlier today I published a short series of posts on some ideas I had for using language models (e.g. ChatGPT and Claude) to help support academic writing. I didn’t plan to write a series of posts. I initially had the idea to test Claude’s capability as a peer reviewer, and as I was finishing up…
-
Journals should be experimenting with LLMs in their editorial workflow
I recently wrote a post about using Claude to peer review an academic paper, and the decent job it did. Based on that experience, I started thinking about the probable impact on journal editorial workflows, a significant part of which is the peer review process. If I was still on an editorial board of a…
-
Glass Health: AI-powered clinical decision support
https://glass.health/ “We combine a large language model with evidence-based, peer-reviewed clinical guidelines created and maintained by our physician team.” As much as I’m a fan of LLMs, I’m not sure how much I’d trust them for supporting clinical decision-making. Their responses, while sounding plausible and authoritative, aren’t anchored to reality. There’s no ‘there’ there. See…
-
Peer review due on Christmas eve…
I’ve just been asked by the editor of a very popular journal if I’d be willing to peer review one of their submissions and the deadline is Christmas eve. I realise that this is an automated email and the editor probably doesn’t know that this is the deadline. I can also obviously complete the review…
-
Comment: A billion-dollar donation: estimating the cost of researchers’ time spent on peer review
We found that the total time reviewers globally worked on peer reviews was over 100 million hours in 2020, equivalent to over 15 thousand years. The estimated monetary value of the time US-based reviewers spent on reviews was over 1.5 billion USD in 2020. For China-based reviewers, the estimate is over 600 million USD, and…
-
Weekly digest (19-23 Jul 2021)
Khetpal, V., & Shah, N. (2021, May 28). How a largely untested AI algorithm crept into hundreds of hospitals. Fast Company. The use of algorithms to support clinical decision-making isn’t new. But historically, these tools have been put into use only after a rigorous peer review of the raw data and statistical analyses used to…
-
Weekly digest (24-28 May 2021)
Ads in academic journals? Recently I had to disable my ad-blocking extensions to troubleshoot a problem I’m having with a service and I forgot to turn them back on. So I was surprised to visit a journal website and see the number of ads displayed down the side. As if journals don’t make enough money…
-
Weekly digest (17-21 May 2021)
Checco, A., Bracciale, L., Loreti, P., Pinfield, S., & Bianchi, G. (2021, May 17). Can AI be used ethically to assist peer review? Impact of Social Sciences. …an AI tool which screens papers prior to peer review could be used to advise authors to rework their paper before it is sent on for peer review.…
-
Article: Which are the tools available for scholars?
In this study, we explored the availability and characteristics of the assisting tools for the peer-reviewing process. The aim was to provide a more comprehensive understanding of the tools available at this time, and to hint at new trends for further developments…. Considering these categories and their defining traits, a curated list of 220 software…
-
What does scholarship sound like?
in this post I’ve tried to describe why podcasts are potentially a useful format for creating and sharing the production of new knowledge, presented a framework for determining if a podcast could be considered to be scholarly, and described the workflow and some practical implications of an accreditation process using a traditional journal.
-
OpenPhysio | A new physiotherapy education journal
I’m really excited to announce a new project that I’ve been working on together with the folks at Physiopedia. Today we’re launching an open access, peer reviewed journal with a focus on physiotherapy education, with a few features that we think are pretty innovative in the academic publishing space. The journal is called OpenPhysio and represents…
-
I enjoyed reading (December)
This post is really delayed, mainly because I took a break from blogging over December and January. I was starting to feel an “obligation to blog”, which is when I know that I need to step back a bit and take some time off. There’s nothing worse than writing because you feel you have to,…
-
Peer review of teaching
Introduction Peer review is a form of evaluation designed to provide feedback to teachers about their professional practice. The standard method of evaluating teaching is to ask students at the end of a module or course, for their feedback on the lecturers performance. While student feedback does have value, it also has limitations. For example,…