Live
- Woman’s False Claim Sparks Unnecessary Panic
- Locals Report Naxal Activity in Karkala Village
- Mangaluru International Airport Sets New Records in Passenger and Flight Movements
- Where Areca failed, grow Coffee
- Collector Badavath Santosh Reviews Household Survey and Listing Process
- Awareness Session on SHE Team and POCSO Act
- Awareness Program in agricultural College on the Dangers of Drug Abuse for Youth
- 3500-Year-Old Menhir in Kamsanpally Village: A Call for Preservation
- The Role of Artificial Intelligence in Radiology: Transforming Diagnosis and Patient Care
- Hindustan Zinc Ltd. Signs MoU with Rajasthan Government to Invest Rs 36 Crores in Education Development
ChatGPT’s answer to healthcare-related queries at par with humans: Study
ChatGPT
ChatGPT's responses to people's healthcare-related queries are nearly indistinguishable from those provided by humans, reveals a new study, suggesting the potential for chatbots to be effective allies to healthcare providers' communications with patients.
New York: ChatGPT's responses to people's healthcare-related queries are nearly indistinguishable from those provided by humans, reveals a new study, suggesting the potential for chatbots to be effective allies to healthcare providers' communications with patients.
In the study, researchers from New York University presented 392 people aged 18 and above with 10 patient questions and responses, with half of the responses generated by a human healthcare provider and the other half by OpenAI’s chatbot ChatGPT.
Participants were asked to identify the source of each response and rate their trust in the ChatGPT responses using a 5-point scale from completely untrustworthy to completely trustworthy.
The study, published in JMIR Medical Education, found people have limited ability to distinguish between chatbot and human-generated responses.
On average, participants correctly identified chatbot responses 65.5 per cent of the time and provider responses 65.1 per cent of the time, with ranges of 49.0 per cent to 85.7 per cent for different questions.
Results remained consistent no matter the demographic categories of the respondents.
The study also found participants mildly trust chatbots' responses overall (3.4 average score), with lower trust when the health-related complexity of the task in question was higher.
Logistical questions (e.g. scheduling appointments, insurance questions) had the highest trust rating (3.94 average score), followed by preventative care (e.g. vaccines, cancer screenings, 3.52 average score).
Diagnostic and treatment advice had the lowest trust ratings (scores 2.90 and 2.89, respectively).
According to the researchers, the study highlights the possibility that chatbots can assist in patient-provider communication particularly related to administrative tasks and common chronic disease management. Further research is needed, however, around chatbots' taking on more clinical roles, said the researchers from NYU Tandon School of Engineering and Grossman School of Medicine.
However, providers should remain cautious and exercise critical judgement when curating chatbot-generated advice due to the limitations and potential biases of AI models, they noted.
