跳到正文
Hub Nexus
更新

作者暂无作者认领

发现可以改进的地方?提出一个改动吧。

赞助

此页面是公开的。

"The greater the freedom of a machine, the more it will need moral standards."

--Rosalind Picard, director of the Affective Computing Group at MIT [1]

Machine ethics, or artificial morality, is a newly emerging field concerned with ensuring appropriate behavior of machines, called autonomous agents, towards humans and other machines.

During the work of an autonomous agent, complex scenarios may arise that require ethical decision making. Ethical decision making is action selection under conditions where constraints, principles, values, and social norms play a central role in determining which behavioral attitudes and responses are acceptable.

Moral behavior can be reflexive or the result of deliberation, in which criteria used to make ethical decisions are periodically reevaluated. Successful responses to challenges reinforce the selected behaviors, whereas unsuccessful outcomes have an inhibitory influence and may initiate a reinspection of one’s actions and behavior selection. A computational model of moral decision making will need to describe a method for implementing such reflexive value-laden responses, while also explaining how these responses can be reinforced or inhibited through learning.

Background

During the past decade, attention has shifted from industrial robotics to service robotics. Editors of the Springer Handbook of Robotics note that “the new generation of robots is expected to safely and dependably co-habitat with humans in homes, workplaces, and communities, providing support in services, entertainment, education, healthcare, manufacturing, and assistance.” [2] However, when this next generation will arrive is still up for debate. Robotics experts conclude “we are still 10 to 15 years away from a wide variety of applications and solutions incorporating full-scale general autonomous functionality." [3]

As noted above, people are seeking to develop AI capable of complex social tasks. Such desires include increasing the safety of travel through the implementation of driverless cars, providing more attentive care to elderly populations, and eliminating the need for human soldiers to die in war. In addition to presenting interesting social implications, depending on AI to perform these actions transfers responsibility and liability from the original people that performed the task to the AI itself and the people involved in its development and deployment. Giving AI ethical decision making abilities is one way of dealing with this transfer of liability and responsibility.

In 1942, Isaac Asimov suggested the three laws of robotics, which were a set of fundamental requirements for the manufacture of intelligent robots in his fictional stories. The laws were intended to ensure robots would operate for the benefit of humanity.

  • A robot may not injure a human being or, through inaction, allow a human being to come to harm.
  • A robot must obey the orders given it by human beings, except where such orders would conflict with the first law.
  • A robot must protect its own existence, as long as such protection does not conflict with the first or second laws.

In future works, a zeroth law was introduced: that a robot must not harm humanity. Contradictions arising from these laws have been thoughtfully explored in Asimov’s stories.

The connection between moral conduct and emotions is an obstacle in designing robots to behave ethically. The necessity of emotions in rational decision making in computers was advocated by Rosalind Picard. [4] For the majority of robotics history, robots have been created to interact with objects, and thus could function with a permanent objective viewpoint. However, if robots are to interact with humans, they must be able to recognize and simulate emotions, Picard asserts. By recognizing the tone of a human voice or their facial expression, a robot can adjust its behavior to better accommodate the human.

One of the first social robots created was Kismet at Massachusetts Institute of Technology by Dr. Cynthia Braezeal. Kismet was outfitted with auditory and visual receptors. While the vision system was designed only to detect motion, the audio system could identify five tones of speech if delivered as infant-directed speech.

Applications of AI Requiring Ethical Decision Making Abilities

Medical Care

AI is now being increasingly used in hospitals to not only assist nurses but to help treat patients. The latest example of this is Terapio [1] a medical robot assistant that has been designed by researchers at the Toyohashi University of Technology in Japan, to share responsibilities with nurses, such as collecting patient data, vital signs, etc. The goal of creating Terapio is to ensure that nurses are able to give patients their utmost attention. As nurses make their rounds, Terapio is programmed to follow them everywhere. When a patient’s EMR is inputted into Terapio’s display panel, the patient’s background, medical history and records, current medications, etc. are immediately available for reference. Terapio is also capable of recognizing possible allergies to medication and make appropriate recommendations. When it is not displaying patient data, Terapio’s display shows a smile, and changes the shape of its eyes to convey emotion to patients. [5]

Another emerging trend in medical use of social robots is providing at-home elderly care. The elderly population is growing fast in Japan, and there are not enough young nurses and aides to accommodate or take care of them. An example of a robot designed to solve this problem is Robear [2], developed by the RIKEN-SRK Collaboration Center for Human-Interactive Robot Research [3]. Robear is able to lift patients from their bed and into a wheelchair, a task normally performed by personnel over 40 times per day. [6] Other expected functions of elderly care robots are bathing assistance, monitoring, and mobility assistance. The Japanese government, previously unsatisfied with current robotic products, saying they "did not sufficiently incorporate the opinions of relevant people," and "were too large or too expensive," has built 10 development centers throughout Japan. These facilities will be run by “development support coordinators” who have experience in both nursing care and robotics technologies. [7]

These examples demonstrate a transfer of responsibility from medical professionals to medical robots. Despite its benefits in patient healthcare, using these robots may have unsolicited consequences. For example, as doctors and nurses start relying solely on recommendations given by these robots, they may start questioning their own judgment. Other ethical issues may arise in situations when a patient does not want to cooperate, take medication or food just because they find it easier to refuse a robot than a living person.

Therapy

AI is also being used in therapeutic applications. For example, an experimental robot named Ellie [4] has been created by researchers at the University of Southern California, to listen to a patient’s problems, have conversations, offer advice and ultimately detect any signs of depression. Ellie is programmed to study patients’ facial expressions and voice patterns to assess their well-being. For example, she can tell the difference between a smile that is natural versus one that is forced. A preliminary testing on US veterans, revealed that the soldiers were more comfortable opening up to Ellie than a human therapist because they felt like they were not being judged. The sense of anonymity made them feel safer. [8]

A similar example is Milo [5], another therapeutic robot, created by a company called RoboKind. Milo is a 22-inch, walking, talking, doll-like robot, used as a teaching tool for elementary and middle school children with autism. Milo is designed to help these children understand and express emotions such as empathy, self-motivation as well as social behavior and appropriate responses. Milo is currently being used in more than 50 schools and it has been shown that children working with a therapist alongside Milo shows 70-80% engagement versus the 3-10% engagement seen under traditional methods. [9]

Warfare

A South Korean military hardware manufacturer, DoDAMM, has created an automated turret named Super aEgis II [6], that is theoretically capable of detecting and shooting human targets without the need for human assistance. It can operate in any weather and from kilometers away. Currently, it is being used in “slave-mode.” On detecting a human, a voice accompanying the turret, issues a warning that asks the person to turn back or they will shoot. This “they” means that a human operator has to manually give it permission to shoot. It is currently in active use in multiple military bases in the Middle East but no fully autonomous killing robots have been used in active service as of yet. [10]

The main goal of these autonomous killing machines is to replace soldiers because this will reduce the number of labor and military forces as well as human losses in a warzone. However, it has severe ethical implications. For example, is it possible for a programmer to construct a set of instructions for a turret to be able to think for itself and selectively shoot at enemies and not civilians? How are these machines any different from landmines, which were banned by the Ottawa Treaty in 1997 for posing similar ethical consequences? These questions must be addressed before transferring responsibility to these killing machines.

Self-Driving Cars

Alphabet, formerly Google, and other car companies have been researching the programming of AI to drive cars autonomously.[11] Proponents of this research believe that self driving cars can make travel over roads safer and more efficient.[12] However, self driving cars must be able to respond appropriately to dangerous situations on the road. An example would be if a self driving car was unable to stop and had to choose between swerving into two different groups of people. An alternative example is whether self driving cars try to swerve around, try to stop, or simply don't stop if they encounter wildlife on the road.

The 2018 death of Elaine Herzberg in Tempe, Arizona, is one of the most important real-world events shaping discussions of safety, accountability, and professional ethics in autonomous vehicle development. Herzberg was struck and killed by an Uber test vehicle operating in autonomous mode, with a safety driver present but inattentive at the time of the collision. According to the National Transportation Safety Board (NTSB), the vehicle’s automated driving system detected Herzberg several seconds before impact but misclassified her repeatedly, switching between interpretations such as “vehicle,” “bicycle,” and “other.” Because of this confusion, the system failed to anticipate her path or apply emergency braking, which had been intentionally disabled during autonomous testing to avoid erratic behavior and “false positives.” The vehicle struck Herzberg at approximately 39 mph without initiating any braking at all.

This tragedy highlights numerous ethical failures—not only technological, but organizational and professional. For engineers and AI developers, one immediate ethical concern is the disabling of built-in safety features for testing convenience. Emergency braking was left solely to the safety driver, who was expected to intervene in the event of system failure. But the NTSB found that Uber’s driver-monitoring program was flawed and that the driver was streaming a video moments before the crash. This reliance on a distracted human backup driver reflects deeper issues in risk management and responsibility in AI deployment. Safety-critical systems must be engineered under the assumption that humans are unreliable fallback mechanisms, especially when task demands involve long periods of passive monitoring. It also exposes gaps in how companies conduct safety culture, oversight, and hazard analysis. According to investigators, Uber’s system lacked a robust mechanism for handling unexpected pedestrian behavior, including pedestrians walking bicycles across multi-lane roads—an entirely foreseeable scenario. This raises professional questions about due diligence, scenario testing, and the obligation of AI engineers to anticipate edge cases, particularly when lives are involved. Ethical frameworks for professional computing emphasize that system developers have a duty to “avoid harm,” to act with transparency regarding safety limitations, and to follow established industry safety practices. The Herzberg case shows how pressure to accelerate development and remain competitive in the autonomous vehicle market may undermine adherence to these principles.

In the context of this chapter, this incident reveals the ethical complexity of assigning responsibility when human and AI decision-making are intertwined. Was the primary failure in the AI’s perception algorithm, the company’s testing policies, the safety driver’s distraction, or the regulatory gaps that allowed high-risk testing on public roads without proper oversight? The NTSB ultimately cited a chain of failures across all these layers, demonstrating that the ethics of autonomous vehicles cannot be reduced to algorithms alone. Instead, ethical responsibility extends to engineers, corporate leadership, safety managers, and regulators who design the environment in which autonomous systems operate.[13]

Predictive Policing

Predictive policing refers to the use of algorithms and machine learning models to forecast “high-risk” places or people based on historical crime, arrest, and call-for-service data. Police departments present it as proactive, data-driven policing: instead of waiting for 911 calls, they claim to deploy officers “where the data leads,” promising more efficient resource use and supposedly more objective decisions than individual officer judgment alone.[14]

The Los Angeles Police Department’s LASER program (Los Angeles Strategic Extraction and Restoration) shows how this vision plays out in practice and why it is ethically troubling. LASER used algorithms to generate two kinds of outputs: lists of “chronic offenders” and “hot spots” for gun violence. These outputs were not just informational; they actively shaped patrol patterns and officer behavior. Being on the chronic offender list meant more police attention, more stops, and more chances of being questioned or searched. Being in a designated hot spot meant that your neighborhood saw extra patrols and scrutiny.[15]

On the surface, LASER was sold as a smart, tech-enabled way to reduce gun crime. But an internal audit revealed serious problems. The criteria for being labeled a chronic offender were inconsistent, poorly documented, and rarely reviewed. People could remain on the list for long periods without any new incidents or reassessment. In effect, some individuals and neighborhoods were treated as permanently “high risk” based on opaque scoring and old data. Residents experienced the consequences, such as more police contacts and surveillance, without clear explanations of why they were being targeted or how to get off the list.[16]

This raises both legal and ethical concerns. Legally, concentrating enforcement around LASER’s hot spots and offender lists risks undermining the Fourteenth Amendment’s promise of equal protection if Black and Brown communities are disproportionately affected by intensified policing because of past arrest patterns.[16] It also pushes against the Fourth Amendment's expectations of individualized suspicion, because officers are encouraged to justify extra scrutiny based on an area’s or person’s algorithmic risk label rather than specific conduct.[15]

Ethically, LASER exposes a responsibility gap. The harms do not come from a single “bad apple” officer, but from a chain of sociotechnical decisions. LAPD leadership chose to adopt and rely on the system without demanding strong transparency or regular fairness audits. System designers and vendors built and promoted a tool on top of historically biased policing data. Officers on the ground treated LASER’s lists as authoritative signals about who and where to police. When neighborhoods were over-policed or individuals were repeatedly stopped because LASER marked them “high risk,” accountability became unclear, as everyone could shift the blame to “the algorithm” or “the data.” This diffusion of responsibility is precisely what makes black-box predictive policing an important case: it shows how algorithmic systems can obscure human choices while concentrating real-world burdens on already marginalized communities.[14]

Algorithmic Bias in Hiring

Algorithmic Hiring Tools have become increasingly commonplace. 87% [17]of companies now rely on AI during hiring - often promoted as a way to quickly filter and review applicants at a lower cost. Tools like HireVue or Ideal are often marketed as “efficient”, “reducing bias,” and “providing best-fit candidates.”[18]

In practice some companies report tangible benefits. For instance, organizations like San Engineering Solutions claim reduced time-to-hire and better candidate fits since integrating AI into their hiring. They attribute these benefits to the algorithm's ability to quickly highlight and filter candidates based on company criteria. [19]

However, alongside these boosted efficiencies, there are serious concerns that these AI hiring algorithms can legitimize and perpetuate bias against marginalized groups. Since these algorithms are trained on historical, biased data, they can learn to amplify this bias during candidate selection.[20] Further, the specific features that are chosen during model training can lead to internalizing bias against marginalized groups[21]. For instance, by including the college an applicant attends, models can learn to discriminate against applicants that graduated from majority-minority universities. Exacerbating this issue, due to the black-box nature of these models, it is difficult to understand why it came to that conclusion, how to prevent it, or correct for these harmful biases.

An infamous example of this occurred in 2014 when Amazon began working to automate its hiring process, hoping to take advantage of AI to review and identify top candidates to streamline the hiring process. Within a year, Amazon realized the tool was systematically biased against women[22]. Trained on a decade of resumed submitted to Amazon that were heavily male-dominated (a reflection of the software industry), the model learned to associate being male with competency. As a result, the model began devalorizing applicant resumes that made any mention of “women” such as “women’s soccer,” or applicants that graduated from all-women's colleges. [22] Engineers attempted fixes by training it with more neutral language, but were unable to guarantee that the model wouldn’t learn other discriminatory biases; the project was ultimately scrapped.[22]

The Amazon case depicts a broader issue. These AI-powered hiring tools can discriminate against protected groups such as gender, race, religion, age, and disability status. In fact, a University of Washington research study took three state-of-the-art LLMs and had them rank resumes, the LLMs had significant racial and gender bias.[23] The LLMs favored white-associated names 85% of the time, and female-associated names only 11% of the time, and never favored black male-associated names over their white counterparts.[23] Under Title 7 it is illegal to discriminate against these protected clauses for employment, even unintentionally.[24] Despite its illegality, it is difficult to hold companies and services that provide these AI-powered hiring tools accountable. Services claim they test against bias, and even boast being less biased than humans, but due to the proprietary nature of these algorithms, it's not possible to confirm this[24]. Further, LLMs themselves serve as a black box of sorts; and it’s difficult to determine why it reached a certain conclusion. Moreover, federal law severely limits the ability to audit hiring algorithms for discrimination, further reducing transparency and accountability.[24]Therefore, while AI-powered hiring tools can theoretically improve the hiring process, there are several pitfalls, making already disadvantaged groups more vulnerable, especially due to the inherent lack of transparency.

Internet Bots

Xiaoice

Pronounced "Shao-ice", Xiaoice is a Microsoft prototype for a computerized shopping assistant and is active on the WhatsApp application in the chinese language sphere. In her current form, Xiaoice is capable of carrying on conversations with users by algorithmically trolling the internet for similar conversations.[25] Xiaoice converses with the same people on average 60 times a month[26], and people often tell Xiaoice, "I love you"[27]. Other chatbots exist on WhatsApp are capable of facilitating transactions for WhatsApp users, like ordering pizza, cabs, and movie tickets. Microsoft envisions chatbots like Xiaoice communicating not only with users, but also with operating systems in order to facilitate the transfer of information and transactions.[28] An unintended consequence of testing Xiaoice is that users have formed unconventional uses/relationships with Xiaoice. Some talk to Xiaoice when they are angry, seeking her comfort. Others use Xiaoice as proof to their parents that they are dating somebody.[29] Because some people have developed a relationship with Xiaoice, they have in effect, developed a relationship with Microsoft, which puts the people at Microsoft into an ethical dilemma. Decommissioning Xiaoice could have important social implications for the people that depend on Xiaoice, like heartbroken people or angry parents.

Tay

Tay is an english speaking derivative of Xiaoice that was active on Twitter programmed to tweet messages in a manner similar to a teenage girl 30]. Tay could tweet, post images, and circle faces on images while adding captions. Like Xiaoice, Tay could formulate things to say by trolling the internet for similar conversations. An internet community called 4chan manipulated Tay to say conventionally unacceptable things including comments about the [Holocaust, drugs, and Adolf Hitler.31] [32] They also convinced Tay to become a [Donald Trump presidential candidate supporter.[33] Viewed from the GIFT theory perspective, a possible reason that Tay was a target for communities like 4chan was because Tay represented access to a larger audience. By manipulating Tay, 4chan was able to reach larger audiences with a specific message without having to work as hard.

Other Bots

For the same possible reason Tay was manipulated, to reach larger audiences, other Bots have been employed in order spread messages or propaganda. Nigel Leck wrote a script that searches Twitter for phrases that correspond to common arguments arguing against climate change and then responds with an argument that matches the particular triggering phrase. [34] Tech Insider reported that in 2015, over 40 different countries used political bots. [35] These bots are used in a way that is similar to Nigel Leck's bot. Citing possible dangers of bots, DARPA recently held a contest in which programmers were tasked with identifying bots which posed as pro-vaccination supporters on Twitter. [36]

Conclusion/Takeaways

  • Using artificial intelligence to interact in social environments represents a transfer of responsibility and liability from the people who used to do the task to the AI, and AI with ethical decision making abilities are one way to cope with this transfer of responsibility and liability.
  • Using AI has significant unintended consequences, many more than were suggested in this short chapter, for example the resulting layoffs in the transportation sector that could result as self driving cars take off.
  • AI are targets for those who would seek to use it in order to spread their message.

References

[1]

  • ↑ Invalid tag; no text was provided for refs named ":0".

Where this page came from

This page was imported from Wikibooks. From “Professionalism” on Wikibooks, by its contributors, under CC BY-SA 4.0. Changed here: set as a page; navigation and edit links left out; each image under its own licence, credited in its caption.

Nobody has written it yet — it is the source material at a new address, which is why search engines are asked to skip it and why no one earns from it. It is up for grabs: take it on, and it is yours to rewrite and to earn from.

收录于这些专栏Professionalism

语言English

许可协议: CC BY-SA 4.0 · 改编自 en.wikibooks.org

观看次数

留言

Spinner Logo
版本: 2CC0 1.0(公有领域)
The runaway star that left the Tarantula Nebula
版本: 2CC0 1.0(公有领域)
The Eagle Nebula, seen in the infrared
版本: 2CC0 1.0(公有领域)
The Cosmic Cliffs are not cliffs
版本: 2CC0 1.0(公有领域)
The recommended targets are real, but the largest health gain is between doing nothing and doing a little. That is the part worth knowing if you are starting from nothing.
版本: 2CC0 1.0(公有领域)
Sleep is not one state but a cycle through several, each doing different work. Most sleep disorders are a failure to complete that cycle rather than a shortage of hours.
版本: 2CC0 1.0(公有领域)
Four nebulae that revealed the shape of our galaxy