Collection

2024 ASEE North East Section

Authors

Abdullah Aldwean, University of Bridgeport ; Dan Tenney, University of Bridgeport

Tagged Topics

Diversity

mechanism called attention [18].Despite the LLM technical characteristics and sophisticated capabilities, the introduction ofconversational-based models such as ChatGPT has established a new paradigm in human-AIinteraction. The wide adoption and the fast diffusion of these models reflect a deep interest in AIbased products by users. According to the OpenAI company, the ChatGPT has 100 millionweekly active users [15].Efficient evaluation is a crucial step in ensuring the applicability of LLMs in the healthcaresector. While automated evaluation methods are more cost and time-efficient, human evaluationremains the golden standard for determining the safety and usefulness of LLM in healthcare.Experts-based evaluation is critical in a sensitive domain