A analysis examine counted how typically ChatGPT made up citations for 3 totally different classes of psychological issues (binge consuming, physique dysmorphic, and main depressive). They used a chi-square to find out if charges of made up citations differed by dysfunction (they do).
If ever there was an article that belonged on this weblog, that is it. You should use it in your stats class for instance of chi-square and/or as a warning to college students in case you ask them to carry out literature evaluations to your class.
The unique paper, Affect of subject familiarity and immediate specificity on quotation fabrication in psychological well being analysis utilizing massive language fashions: Experimental Examine was printed in December 2025, and summarized by PsyPost shortly after publishing.
What the researchers did:
What the researchers discovered:
Easy methods to use in school:
1. This can be a good chi-square outcomes part. They shared the check worth and the p worth, in fact, however I like how they shared the various charges of inaccuracy as absolute information and percentages all through. Chi-squares may be tough to current in textual content (versus a desk) and the authors did a superb job right here.
2. In case you are speaking to your college students about correct use of AI: These researchers shared their precise prompts of their supplemental materials. This demonstrates a) correct, moral citations of prompts when utilizing AI in analysis and that b) the well-written prompts nonetheless resulted in bogus information.
