MIT Study Reveals AI’s Rule Violation Failure: Disturbing Inaccuracies Uncovered

May 29, 2023
1 min read
Credit- DeltaWorks

Machine-learning models designed to mimic human decision-making can sometimes make harsher judgments than humans regarding rule violations. MIT researchers have found that machine-learning models often fail to replicate human decisions about rule violations. AI Models trained with descriptive data tend to over-predict rule violations compared to human judgments. The use of descriptive data to train machine-learning models can have serious impacts on criminal justice systems and many other areas.

Artificial intelligence systems may make harsher judgments on rule violations based solely on rules, without human nuance. Normative data, labeled by humans who explicitly determine rule violations, is crucial for training machine-learning models. Descriptive data, which focuses on factual features, are often used to train models, leading to over-prediction of rule violations.

The study by MIT examined how AI models judge perceived breaches of a code using normative and descriptive data. Normative data involves knowing whether a post breaks a specific rule, while descriptive data focuses on factual features. Human participants were more likely to declare a code breach using the descriptive method compared to the normative one.

Inaccuracies in machine-learning models can have significant real-world implications, affecting decisions like bail amounts or criminal sentences. Greater transparency in data collection is necessary to address the flaws in training machine-learning models.

Professor Marzyeh Ghassemi emphasizes the significance of the study’s findings and the potential harm caused by biased models. The study highlights the need for using data that aligns with the intended context of the machine-learning task. Differentiating between descriptive and normative data is essential to reproduce human judgment accurately.

Transparent acknowledgment of data collection methods is necessary to ensure fairness in machine learning systems. Repurposing descriptive data for normative judgments can lead to models with extremely harsh moderations. Humans consider nuance and make distinctions that machine-learning models often fail to replicate.


Similar Posts


The study conducted by MIT involved the labeling of dog images to examine normative and descriptive responses. Normative labelers who knew the rules were more accurate in identifying policy violations compared to descriptive labelers. The disparity between descriptive and normative labels ranged from 8 to 20 percent across different datasets.

The accuracy of machine-learning models trained with descriptive data was lower, especially in cases of disagreement among human labelers. Dataset transparency and understanding data gathering methods are crucial to address the training flaws. Fine-tuning descriptively trained models using a small amount of normative data can help mitigate the problem.

Transfer learning and involving expert labelers like doctors or lawyers could provide further insights into label disparities. Transparent acknowledgment of data collection methods and careful selection of data for training are essential to ensure fair and accurate machine learning systems. The research received funding from various institutions, including the Schwartz Reisman Institute for Technology and Society, Microsoft Research, and the Canada Research Council Chain.

Rahul Somvanshi

Rahul, possessing a profound background in the creative industry, illuminates the unspoken, often confronting revelations and unpleasant subjects, navigating their complexities with a discerning eye. He perpetually questions, explores, and unveils the multifaceted impacts of change and transformation in our global landscape. As an experienced filmmaker and writer, he intricately delves into the realms of sustainability, design, flora and fauna, health, science and technology, mobility, and space, ceaselessly investigating the practical applications and transformative potentials of burgeoning developments.

Leave a Reply

Your email address will not be published.

Latest from Blog

American Public Schools Face Higher Air Pollution

Different races and ethnicities now have access to different air quality, particularly in areas near highways and industrial areas. The first national trends in exposure to nitrogen dioxide and fine particle pollution
Geothermal Plant

Philippines To Get New Geothermal Plants For Clean Energy

Energy Development Corporation President and Chief Operation Officer Richard Tantoco were recognized as one of this year’s ESG, Diversity, and Climate Trailblazers in Governance, Risk, Compliance (GRC) company Diligent’s 2022 Modern Governance

Hard & Durable Material Made From Mushrooms: MyLea

Mycotech is a startup based in Indonesia. They create sustainable products, bio-fibers and majorly specialize in MyLea, a form of sustainable leather. BioBo – bricks made from mushroom and mycelium are sustainable
Provocative Art Made From Daily Trash

Provocative Art Made From Daily Trash

Provocative Art Made From Daily Trash Pablo Llana is a contemporary artist, based out of Tijuana, Mexico. He had been publishing artworks since 2010. His work sculptures are upcycled from food-products waste

Don't Miss

The UN’s role in setting international rules for the use of A.I.

UN Expert Carme Artigas Reveals AI’s Future in Governance and Society

The evolution of artificial intelligence (AI) is akin