15 person (say with a usefulness score of a 5 out of 7), it might be preferable to have a bundle of advice consisting of a 1/7 and a 7/7. After all, the advice seeker has the option to ignore the advice at minimal cost. We did not prompt the model to behave or think in a controversial manner. Evaluating a system that is prompted to be more controversial or one that generates multiple conflicting viewpoints is an interesting opportunity for future research. As mentioned before, this might also require models that have been exposed to less or no human feedback to allow more for eccentric viewpoints. Implications To the extent it has not become clear by now - we are big fans of Dr. Appiah and regular readers of his New York Times column. Neither of us is an expert in ethical decision making and we feel that we have derived an enormous educational value by reading the dilemmas submitted to The Ethicist and the ethical advice provided by Dr. Appiah. In other words, we did not design this study to put Dr. Appiah out of work. Rather, we are excited about the possibility that AI allows all of us, at any moment, and without a significant delay, to have access to high quality ethical advice through technology. The use cases we have in mind are thus not to replace ethics consultants. Presently, given time, budget, and convenience constraints, in most situations of human decision making involving a professional ethics consultant (not to mention sending an email to a newspaper) is not considered, even if such an involvement would be beneficial. As we demonstrated in this study, AI can play a valuable role in those settings and, at least partially, address this unmet need by providing useful ethical advice. AI has never been married, it has no human desires, and it does not own any assets. Yet, models based on AI can provide us with valuable marital advice, guide our human behavior, and inform us how we deal with our possessions. All models are wrong - but that does not mean that ethical advice generated by AI cannot be useful.

Can AI Provide Ethical Advice? - Page 15 Can AI Provide Ethical Advice? Page 14