Data and Artificial Intelligence Ethics
An app on your phone suggests the next video, a bank decides whether to give you a card, and a chatbot answers your homework in seconds. Behind all of this is artificial intelligence (AI). An AI doesn't think on its own: it learns from examples created by people, with their successes and their prejudices. Who is responsible when those decisions go wrong? We find out on this page.
Algorithmic Bias
Imagine learning to recognize dogs by looking only at photos of German shepherds: faced with a chihuahua, you would hesitate. The same happens with AI: it learns from training data, and if some cases are abundant and others barely appear, it fails more often with the underrepresented ones. The problem is not the machine's "ill will," but the data (and the people who chose it).
Explain with an example what algorithmic bias is, and why an artificial intelligence trained on limited or unbalanced data can treat certain groups of people unfairly.
Explain with an example what algorithmic bias is, and why an artificial intelligence trained on limited or unbalanced data can treat certain groups of people unfairly.
The figure summarises how an artificial intelligence system learns: from examples. The training data in the example contain many cases of one type and very few of…
The figure summarises how an artificial intelligence system learns: from examples.
The training data in the example contain many cases of one type and very few of another. Explain what problem will arise in the decision marked with ?, where this problem actually comes from, and how it could be corrected.
A company uses artificial intelligence to screen CVs, and the system rejects more applications from women because in the past the company mainly hired men. Explain where…
A company uses artificial intelligence to screen CVs, and the system rejects more applications from women because in the past the company mainly hired men. Explain where this bias comes from, why "the machine made the decision" does not relieve the company of responsibility, and what measure would fix the system.
Chatbots, Hallucinations, and Responsibility
A chatbot is a program that converses in natural language; the most recent ones generate text by predicting which words sound most probable, not by consulting a database of verified facts. That is why they can "hallucinate."
Explain what a chatbot is, why it can state made-up facts with complete confidence (so-called "hallucinations"), and what you should always do when it gives you an…
Explain what a chatbot is, why it can state made-up facts with complete confidence (so-called "hallucinations"), and what you should always do when it gives you an important piece of information: a date, a figure, or a source.
If a self-driving car hits a pedestrian, who is responsible? Set out the options (owner, manufacturer, programmer, shared liability) and defend an initial position with…
If a self-driving car hits a pedestrian, who is responsible? Set out the options (owner, manufacturer, programmer, shared liability) and defend an initial position with an argument.
The classic trolley problem applied to self-driving cars: if an accident is unavoidable, how does the car decide whom to put at risk? Analyse who should make that…
The classic trolley problem applied to self-driving cars: if an accident is unavoidable, how does the car decide whom to put at risk? Analyse who should make that decision (the engineer, the law, a citizen panel) and defend an argued position.
Black Boxes and Recommendation Algorithms
Explain what data a video platform's recommendation algorithm uses to select the next video (what you watch, for how long, what you skip) and why it tends to lead you…
Explain what data a video platform's recommendation algorithm uses to select the next video (what you watch, for how long, what you skip) and why it tends to lead you towards increasingly intense or extreme content.
Explain what it means for an artificial intelligence to function as a "black box", and why it is concerning that even its creators cannot explain a specific decision,…
Explain what it means for an artificial intelligence to function as a "black box", and why it is concerning that even its creators cannot explain a specific decision, such as denying a grant or a loan.
A local municipality proposes installing facial recognition cameras "to improve security". Construct a balanced argument: two potential benefits, two risks to privacy,…
A local municipality proposes installing facial recognition cameras "to improve security". Construct a balanced argument: two potential benefits, two risks to privacy, and one condition you consider essential before approving the measure.
Training Data, Copyright, and Hidden Labor
Who is the author and who does the invisible work
If an AI composes a song "in the style of" an artist, whose is it? There are different positions: the programmer's, the person who wrote the prompt's, nobody's, or that the imitated artist deserves recognition and payment. Also think about what the human contributes: intention, experience, and responsibility.
In addition, labeling data to train an AI (marking what is in a photo or reviewing violent content) is often outsourced to countries with very low wages. A fair chain would require a decent wage, psychological support, and transparency about who does that work. It is a case of what you have already seen as data colonialism: the benefit stays in some places and the cost in others.
Technological Sovereignty
If only a few players control the chips, the clouds, and the large models, those who depend on them accept their prices, rules, and conditions on data. This is technological dependence. That is why open alternatives and local development matter.
Artificial intelligence systems learn using "training data". Explain why how these data were obtained matters, and evaluate the case of millions of photos of people…
Artificial intelligence systems learn using "training data". Explain why how these data were obtained matters, and evaluate the case of millions of photos of people being used without their consent to train a facial recognition system.
Explain what is meant by technological sovereignty, and why there is concern about a small number of countries or companies controlling the microchips, cloud…
Explain what is meant by technological sovereignty, and why there is concern about a small number of countries or companies controlling the microchips, cloud infrastructure, and large artificial intelligence models on which millions of people depend.
AI image generators learn from artists' artwork, often without paying or asking for permission. Analyse the conflict between innovation and copyright, and evaluate…
AI image generators learn from artists' artwork, often without paying or asking for permission. Analyse the conflict between innovation and copyright, and evaluate proposed solutions: training licences, opt-out lists, and labelling generated artwork.
Much of the work of labelling data to train artificial intelligence is outsourced to countries with very low wages, including the review of traumatic content. Analyse…
Much of the work of labelling data to train artificial intelligence is outsourced to countries with very low wages, including the review of traumatic content. Analyse what injustices you see in this global supply chain, and what conditions (fair pay, psychological support, transparency) you would demand from companies outsourcing this work.
An artificial intelligence composes a song imitating an artist's style. Who owns the work? Analyse the perspectives (the programmer, the user, no one, the imitated…
An artificial intelligence composes a song imitating an artist's style. Who owns the work? Analyse the perspectives (the programmer, the user, no one, the imitated artist), what value humans bring to art, and argue for a reasonable solution.
Deepfakes and People's Rights
AI can fabricate very believable fake videos, audio, and images (deepfakes). When a person's likeness is used without permission, their image and their honor are violated, even if it is presented "as a joke."
A fake video of a female classmate "singing" something ridiculous is created, and the whole school laughs. Analyse which rights it infringes (image rights, reputation),…
A fake video of a female classmate "singing" something ridiculous is created, and the whole school laughs. Analyse which rights it infringes (image rights, reputation), what responsibility lies with the creator and those who forward it, and what she and those receiving it should do.
Planned Obsolescence and Environmental Cost
Examples: sealed batteries that cannot be replaced, glued-in parts, lack of spare parts, or no longer sending updates to a phone that still works. Behind it is a commercial interest: selling more. The environment pays the cost in the form of electronic waste and the mining of new materials.
Explain what planned obsolescence is and give an example of a design decision that shortens the lifespan of a cell phone.
Explain what planned obsolescence is and give an example of a design decision that shortens the lifespan of a cell phone.
A manufacturer stops updating a cell phone model after two years even though the device works well. Analyze the interests behind this decision, the environmental impact…
A manufacturer stops updating a cell phone model after two years even though the device works well. Analyze the interests behind this decision, the environmental impact generated in the form of electronic waste, and what alternatives consumers have to extend the lifespan of the device.
Your phone works perfectly, but "it's no longer trendy". Analyse how this sense of perceived obsolescence is created (advertising campaigns, updates that slow things…
Your phone works perfectly, but "it's no longer trendy". Analyse how this sense of perceived obsolescence is created (advertising campaigns, updates that slow things down, social pressure), and what tools consumers have to avoid falling into this trap.
Training a large artificial intelligence model consumes as much electricity as hundreds of homes in a year, and every query also consumes energy. Explain what…
Training a large artificial intelligence model consumes as much electricity as hundreds of homes in a year, and every query also consumes energy. Explain what sustainability questions companies should answer and what responsible use criteria you could apply.
Responsible Use of AI
A practical criterion: ask yourself, "After using it, do I understand more, or did I just hand in something?" If the AI does your thinking for you, you don't learn what the assignment was meant to teach.
A fair and workable classroom rule could be: AI may be used to understand and review, you must state how it was used, and key assessments are done without it.
Is technology neutral? Should AI be paused?
People say "technology is neutral: it all depends on how it's used." Qualify that: bias and planned obsolescence come from design decisions, so technology reflects the interests of those who create it. That is why there are regulation debates, such as pausing the most powerful AIs: in favor is the precautionary principle; against are international competition and the benefits that would be delayed. A reasonable minimum regulation calls for transparency, audits, and clearly identified responsible parties.
A school uses artificial intelligence to grade essays. Analyse its advantages (speed, consistent criteria, does not get tired) and its risks (does not understand irony,…
A school uses artificial intelligence to grade essays. Analyse its advantages (speed, consistent criteria, does not get tired) and its risks (does not understand irony, penalises unconventional styles, errors with no appeal process), and define what human oversight you would demand before accepting its marks.
Artificial intelligence assistants write full texts in seconds. Analyse which uses are legitimate in your studies and which undermine learning, and propose a classroom…
Artificial intelligence assistants write full texts in seconds. Analyse which uses are legitimate in your studies and which undermine learning, and propose a classroom rule on the use of AI that you consider fair and enforceable.
Evaluate the statement "technology is neutral: it all depends on how it is used". Use the examples of algorithmic bias and planned obsolescence to support or qualify it…
Evaluate the statement "technology is neutral: it all depends on how it is used". Use the examples of algorithmic bias and planned obsolescence to support or qualify it with arguments.
Design an "ethical traffic light" system for student use of artificial intelligence: which uses would be green (learning, accessibility, practising languages), amber…
Design an "ethical traffic light" system for student use of artificial intelligence: which uses would be green (learning, accessibility, practising languages), amber (translating entire homework tasks, generating images of real people), and red (impersonation, fabricating fake news, presenting AI-generated text as your own). Justify each category.
Some experts called for a pause in the development of the most powerful artificial intelligence models until clear rules are in place. Argue in favour (precautionary…
Some experts called for a pause in the development of the most powerful artificial intelligence models until clear rules are in place. Argue in favour (precautionary principle) and against (international competition, delaying beneficial uses) and propose a set of minimum regulations that you consider reasonable.
Go back to the beginning: an AI's decisions are neither magical nor neutral; they come from human data and designs, and that is why the people who create and use them are accountable for them.