Screen Readers Skip to Content

Ethical Debate On Self-Driving Cars and Decision Making Algorithms

Published: 2017-10-09 - Updated: 2018-06-21
Author: University of Massachusetts Lowell | Contact:
Peer-Reviewed Publication: N/A

Synopsis: Should your self-driving car protect you at all costs, or should it steer you into a ditch, potentially causing serious injury, to avoid hitting a school bus.

Should your self-driving car protect you at all costs? Or should it steer you into a ditch - potentially causing serious injury - to avoid hitting a school bus full of children?


Main Digest

Should your self-driving car protect you at all costs? Or should it steer you into a ditch - potentially causing serious injury - to avoid hitting a school bus full of children?

This article is from our digest of publications relating to Disability Transport Services that also includes:

Those are the kinds of questions that preoccupy Nicholas Evans, a UMass Lowell assistant professor of philosophy who teaches engineering ethics and studies the ethical dilemmas posed by emerging technologies, including drones and self-driving vehicles.

"You could program a car to minimize the number of deaths or life-years lost in any situation, but then something counterintuitive happens: When there's a choice between a two-person car and you alone in your self-driving car, the result would be to run you off the road," Evans said. "People are much less likely to buy self-driving vehicles if they think theirs might kill them on purpose and be programmed to do so."

Now Evans has won a three-year, $556,650 National Science Foundation grant to construct ethical answers to questions about autonomous vehicles, translate them into decision-making algorithms for the vehicles and then test the public health effects of those algorithms under different risk scenarios using computer modeling.

He will be working with two fellow UMass Lowell faculty members, Heidi Furey, a lecturer in the Philosophy Department, and Yuanchang Xie, an assistant professor of civil engineering who specializes in transportation engineering. The research team also includes Ryan Jenkins, an assistant professor of philosophy at California Polytechnic State University, and experts in public health modeling at Gryphon Scientific.

Although the technology of autonomous vehicles is new, the ethical dilemmas they pose are age-old, such as how to strike the balance between the rights of the individual and the welfare of society as a whole. That's where the philosophers come into the equation.

"The first question is, 'How do we value, and how should we value, lives?' This is a really old problem in engineering ethics," Evans said.

He cited the cost-benefit analysis that Ford Motor Co. performed back in the 1970s, after engineers designing the new Pinto realized that its rear-mounted gas tank increased the risk of fires in rear-end crashes. Ford executives concluded that redesigning or shielding the gas tanks would cost more than payouts in lawsuits, so the company did not change the gas tank design.

Most people place a much higher value on their own lives and those of their loved ones than car manufacturers or juries do, Evans said. At least one economist has proposed a "pay-to-play" model for decision-making by autonomous vehicles, with people who buy more expensive cars getting more self-protection than those who buy bare-bones self-driving cars.

While that offends basic principles of fairness because most people won't be able to afford the cars with better protection, Evans said, "it speaks to some basic belief we have that people in their own cars have a right to be saved, and maybe even saved first."

Understanding how computers "think" - by sorting through thousands of possible scenarios according to programmed rules and then rapidly discarding 99.99 percent of them to arrive at a solution - can help create better algorithms that maintain fairness while also providing a high degree of self-protection, Evans said. For example, the self-driving car approaching the school bus could be programmed to first discard all options that would harm its own passenger, then sort through the remaining options to find the one that causes least harm to the school bus and its occupants, he said.

Although it's not quite that simple - most people would agree that a minor injury to the autonomous vehicle's occupant is worth it to prevent serious injuries to 20 or 30 schoolchildren - it's a good starting point for looking at how much risk is acceptable and under what circumstances, according to Evans.

Evans and his team also will look at other issues, including the role of insurance companies in designing algorithms and the question of how many autonomous vehicles have to be on the road before they reduce the overall number of accidents and improve safety.

The NSF also asked Evans and his team to look at potential cybersecurity issues with autonomous vehicles. Today's cars could be vulnerable to hacking through unsecured Bluetooth and Wi-Fi ports installed for diagnostic purposes, but large-scale hacking of self-driving cars is potentially much more dangerous.

There are also important privacy questions involving the data that an autonomous vehicle's computer collects and stores, including GPS data and visual images from the car's cameras, Evans said.

Post to Twitter Add to Facebook

Disabled World is an independent disability community established in 2004 to provide disability news and information to people with disabilities, seniors, their family and/or carers. See our homepage for informative news, reviews, sports, stories and how-tos. You can also connect with us on Twitter and Facebook or learn more about Disabled World on our about us page.


Disabled World provides general information only. The materials presented are never meant to substitute for professional medical care by a qualified practitioner, nor should they be construed as such. Financial support is derived from advertisements or referral programs, where indicated. Any 3rd party offering or advertising does not constitute an endorsement.

Cite This Page (APA): University of Massachusetts Lowell. (2017, October 9). Ethical Debate On Self-Driving Cars and Decision Making Algorithms. Disabled World. Retrieved August 18, 2022 from

Permalink: <a href="">Ethical Debate On Self-Driving Cars and Decision Making Algorithms</a>