Roose K (2024) Can A.I. be blamed for a teen’s suicide? The New York Times. Retrieved (December 7, 2024), https://www.nytimes.com/2024/10/23/technology/characterai-lawsuit-teen-suicide.html. Sadasivan C, Cruz C, Dolgoy N, Hyde A, Campbell S, McNeely M, Stroulia E, Tandon P (2023) Examining Patient Engagement in Chatbot Development Approaches for Healthy Lifestyle and Mental Wellness Interventions: Scoping Review. J Particip Med 15:e45772. Siggelkow N, Terwiesch C (2019) Connected Strategy: Building Continuous Customer Relationships for Competitive Advantage (Harvard Business Press). Volpp KG, Troxel AB, Mehta SJ, Norton L, Zhu J, Lim R, Wang W, et al. (2017) Effect of Electronic Reminders, Financial Incentives, and Social Support on Outcomes After Myocardial Infarction: The HeartStrong Randomized Clinical Trial. JAMA Internal Medicine 177(8):1093–1101. i There are also many different choices of algorithms for comparing user queries to chunks stored in a database. When multiple pieces of information are relevant, they need to be ordered (ranked) to ensure that the bot focuses on the most pertinent data. To improve chunking performance, chunks can be infused with additional information (Anthropic 2024). For instance, homework questions on a business case could repeat key information from the case in each chunk to improve retrieval performance. Alternatively, screenshots of documents can be used instead of text (Faysse et al. 2024). This approach reduces the reliance on efficient chunking and leverages existing formatting in documents. ii Prompt-caching can be an effective solution to improve responsiveness and lower costs for information that remains static over multiple LLM calls.