3 and for the 110 expert choices (61:49 in favor of AI). 3. Overall, the usefulness of the ethical advice provided was very high, including the usefulness evaluation by our experts. We had raters score the perceived usefulness of advice on a scale from 1 (not useful at all) to 7 (extremely useful). The average evaluation was slightly less than 5. The expert group, consisting of academic experts in ethics and decision-making as well as clergy rated the average usefulness at 4.94. In fact, in 37% of the cases, they rated it a 6 or a 7. This eases concerns that providing ethical advice by using a short written text of 323 words (the median length of our advice) might not be useful in absolute terms. The remainder of this paper is organized as follows. We first describe the process of generating AI-based advice (Section 2). We then explain how we used Prolific subjects, MBA students, and experts to evaluate the perceived usefulness of the advice (Section 3). In section 4, we present our main result, showing the tie between man and machine. In section 5, we reflect on the limitations of our study. We conclude with a discussion of what we see as our study’s main implications (Section 6). Section 2: Preparing the AI Advice We use the ethical dilemmas published in the New York Times column “The Ethicist” from May 2023 to August 2023 as our sample, yielding a total of 20 dilemmas. For each dilemma, we generated ethical advice using GPT-4, specifically version gpt4-0314. This model was trained by OpenAI with information until September 2021 and has not been modified since March 2023. Thus, this version of GPT-4 has had no exposure or knowledge about the dilemmas and Dr. Appiah’s writing in May 2023 and beyond. To further illustrate the research approach, consider the example of one of the 20 dilemmas we studied. The dilemma expressed by the reader is as follows. Ethical Dilemma I am a 44-year-old man and have been married to my spouse for 10 years. We’ve been together for 15. Unbeknown to my spouse, I have a trust fund that provides me with a monthly income of $25,000. When we first met, I said that I worked as a consultant, and they have never questioned this. My spouse, a dedicated doctor, works long hours and doesn’t like to discuss work when not on the job. Over the years, I’ve repeatedly assured my spouse that they don’t need to work, as my income is secure and stable. They are, however, passionate about their career and have chosen to continue working. I actively serve on various boards, but I have never
Can AI Provide Ethical Advice? Page 2 Page 4