algorithmic accountability
In plain wordsThe idea that the people and organizations behind automated decision systems must be able to explain and justify those systems' effects, answer for the harm they cause, and fix it.
The principle, and the set of practices, by which organizations that build or deploy algorithmic systems can be held answerable for their effects on people. It combines transparency (documentation such as model cardsmodel card, n.: A short document published with an AI model explaining what it is for, how it was trained and tested, how well it works for different groups of people, and its known limits. and disclosure that an algorithm is in use), assessment (impact assessmentsalgorithmic impact assessment, n.: A structured review, done before and during the use of an automated system, of whom it could affect and how — such as unfair treatment or privacy harms — and what will be done about it., auditsAI audit, n.: An independent check of an AI system, or of the company using it, against agreed standards — for example, testing whether a hiring tool treats women and men fairly., monitoring for biasalgorithmic bias, n.: Unfairness in software that judges or serves people: it consistently produces worse results for some groups, such as women, older people or ethnic minorities, often because it learned from skewed or incomplete records.), contestability (notice, explanation and appeal for affected people; see right to explanationright to explanation, n.: The idea that a person affected by a decision made or shaped by an algorithm — a refused loan, a rejected job application — is entitled to a meaningful account of why.) and consequences (liability, regulatory enforcement, redress). The concept stresses that accountability attaches to people and institutions, not to software, and that it requires a forum able to demand answers and impose consequences. It underpins laws such as the Colorado AI ActColorado AI Act, prop. n.: A Colorado law, first passed in 2024, governing AI used to make important decisions about people, such as hiring, lending and housing. In 2026 it was rewritten as a narrower law that starts in 2027., New York City's bias-audit law for hiring toolsautomated employment decision tool, n.: Software that scores, ranks or screens job candidates or employees. New York City requires employers using such tools to have them checked for bias every year and to tell applicants. and parts of the EU AI ActEU AI Act, prop. n.: The European Union's law on artificial intelligence, the first broad AI law anywhere: it bans some uses, sets strict checks for risky ones and puts duties on the makers of the biggest AI models., and the US Algorithmic Accountability Act, introduced repeatedly since 2019 without passing.
Algorithmic accountability means someone at the agency can explain why the benefits model flagged her case.
Origin
Popularized by journalism scholar Nicholas Diakopoulos, whose 2014 Tow Center report 'Algorithmic Accountability Reporting: On the Investigation of Black Boxes' described reporting on the power of algorithms; the phrase then spread through the fairness, accountability and transparency (FAccT) research community. Senators Ron Wyden and Cory Booker and Representative Yvette Clarke introduced the federal Algorithmic Accountability Act in 2019.
Related
- algorithmic impact assessmentalgorithmic impact assessment, n.: A structured review, done before and during the use of an automated system, of whom it could affect and how — such as unfair treatment or privacy harms — and what will be done about it.
- AI auditAI audit, n.: An independent check of an AI system, or of the company using it, against agreed standards — for example, testing whether a hiring tool treats women and men fairly.
- automated decision-makingautomated decision-making, n.: When a computer system, rather than a person, makes or effectively makes a decision about someone — such as approving credit, screening job applicants or flagging possible welfare fraud.
- right to explanationright to explanation, n.: The idea that a person affected by a decision made or shaped by an algorithm — a refused loan, a rejected job application — is entitled to a meaningful account of why.
- algorithmic biasalgorithmic bias, n.: Unfairness in software that judges or serves people: it consistently produces worse results for some groups, such as women, older people or ethnic minorities, often because it learned from skewed or incomplete records.
- responsible AIresponsible AI, n.: An umbrella name for the practices organizations use to keep their AI systems fair, safe, private and accountable, from the first design meeting to everyday use.
- AI liabilityAI liability, n.: Who has to pay or answer in court when an AI system causes harm — the company that built it, the business that used it or the person who relied on it — and under which laws.
Sources
- Diakopoulos, N. (2014). Algorithmic Accountability Reporting: On the Investigation of Black Boxes. Tow Center for Digital Journalism, Columbia University.
Mentioned in
AI governanceAI governance, n.: The rules, institutions and habits that shape how AI is built and used — from laws and treaties to technical standards and a company's own review processes., AI auditAI audit, n.: An independent check of an AI system, or of the company using it, against agreed standards — for example, testing whether a hiring tool treats women and men fairly., AI liabilityAI liability, n.: Who has to pay or answer in court when an AI system causes harm — the company that built it, the business that used it or the person who relied on it — and under which laws., AI transparencyAI transparency, n.: Openness about AI: telling people when they are dealing with one, how a system was built and tested, and why it reached a particular decision., algorithmalgorithm, n.: A precise, step-by-step procedure for solving a problem or doing a task, like a recipe a computer can follow. In the news, 'the algorithm' often means software that ranks what you see online., algorithmic impact assessmentalgorithmic impact assessment, n.: A structured review, done before and during the use of an automated system, of whom it could affect and how — such as unfair treatment or privacy harms — and what will be done about it., automated decision-makingautomated decision-making, n.: When a computer system, rather than a person, makes or effectively makes a decision about someone — such as approving credit, screening job applicants or flagging possible welfare fraud., black boxblack box, n.: A system whose inner workings are hidden or too complex to understand: we can see what goes in and what comes out, but not why it gave a particular answer., Blueprint for an AI Bill of RightsBlueprint for an AI Bill of Rights, prop. n.: A 2022 White House document listing five protections Americans should have when automated systems affect their lives — safety, fairness, privacy, explanation and a human alternative. It was guidance, not law., COMPASCOMPAS, prop. n.: Commercial software used in parts of the US justice system to rate how likely someone is to commit another crime; a 2016 news investigation asking whether it was unfair to Black defendants made it famous., ethics washingethics washing, n.: Using talk of ethics, such as principles, advisory boards or pledges, to look responsible and head off regulation, without actually changing what a company does., predictive policingpredictive policing, n.: Using computer programs to forecast where crimes are likely to happen, or who is likely to be involved, so that police can decide where to patrol or whom to watch., responsibility gapresponsibility gap, n.: The problem that when an AI system that learns or acts on its own causes harm, it may be unclear whether anyone (its makers, users or operators) can fairly be held responsible., right to explanationright to explanation, n.: The idea that a person affected by a decision made or shaped by an algorithm — a refused loan, a rejected job application — is entitled to a meaningful account of why., RobodebtRobodebt, prop. n.: An Australian government program that used an automated calculation to accuse hundreds of thousands of welfare recipients of owing money, often wrongly. An official inquiry later found it unfair and illegal., Section 230Section 230, prop. n.: A 1996 US law that generally protects websites and apps from being sued over what their users post, and lets them remove content in good faith. Whether it protects what AI chatbots themselves say is unsettled., algorithm filingalgorithm filing, n.: China's requirement that companies register certain algorithms — such as recommendation feeds and chatbots — with the internet regulator, describing what they do and how their risks are controlled., Kate CrawfordKate Crawford, prop. n.: An Australian scholar who studies the social, political and environmental costs of AI, co-founded the AI Now Institute, and wrote 'Atlas of AI'., Magnifica HumanitasMagnifica Humanitas, prop. n.: Pope Leo XIV's 2026 letter to the Catholic Church and the world about artificial intelligence, arguing that AI must serve human dignity and the common good.