RESUMO
BACKGROUND: This study aims to compare the performance of ChatGPT-3.5 (GPT-3.5) and ChatGPT-4 (GPT-4) on the American Society for Surgery of the Hand (ASSH) Self-Assessment Examination (SAE) to determine their potential as educational tools. METHODS: This study assessed the proportion of correct answers to text-based questions on the 2021 and 2022 ASSH SAE between untrained ChatGPT versions. Secondary analyses assessed the performance of ChatGPT based on question difficulty and question category. The outcomes of ChatGPT were compared with the performance of actual examinees on the ASSH SAE. RESULTS: A total of 238 questions were included in the analysis. Compared with GPT-3.5, GPT-4 provided significantly more correct answers overall (58.0% versus 68.9%, respectively; P = 0.013), on the 2022 SAE (55.9% versus 72.9%; P = 0.007), and more difficult questions (48.8% versus 63.6%; P = 0.02). In a multivariable logistic regression analysis, correct answers were predicted by GPT-4 (odds ratio [OR], 1.66; P = 0.011), increased question difficulty (OR, 0.59; P = 0.009), Bone and Joint questions (OR, 0.18; P < 0.001), and Soft Tissue questions (OR, 0.30; P = 0.013). Actual examinees scored a mean of 21.6% above GPT-3.5 and 10.7% above GPT-4. The mean percentage of correct answers by actual examinees was significantly higher for correct (versus incorrect) ChatGPT answers. CONCLUSIONS: GPT-4 demonstrated improved performance over GPT-3.5 on the ASSH SAE, especially on more difficult questions. Actual examinees scored higher than both versions of ChatGPT, but the margin was cut in half by GPT-4.
RESUMO
Three-dimensional force plates are important tools for biomechanics discovery and sports performance practice. However, currently, available 3D force plates lack portability and are often cost-prohibitive. To address this, a recently discovered 3D force sensor technology was used in the fabrication of a prototype force plate. Thirteen participants performed bodyweight and weighted lunges and squats on the prototype force plate and a standard 3D force plate positioned in series to compare forces measured by both force plates and validate the technology. For the lunges, there was excellent agreement between the experimental force plate and the standard force plate in the X-, Y-, and Z-axes (r = 0.950-0.999, p < 0.001). For the squats, there was excellent agreement between the force plates in the Z-axis (r = 0.996, p < 0.001). Across axes and movements, root mean square error (RMSE) ranged from 1.17% to 5.36% between force plates. Although the current prototype force plate is limited in sampling rate, the low RMSEs and extremely high agreement in peak forces provide confidence the novel force sensors have utility in constructing cost-effective and versatile use-case 3D force plates.