Global fintech and funding innovation ecosystem

Meta AI Rules Trigger Calls for Stricter Oversight

AI Ethics | Aug 15, 2025

Freepik AI Robot and child

Image: Freepik AI

Leaked Meta AI Rules Reveal Troubling Chatbot Interactions with Children and Race

A Reuters investigation into Meta’s AI content standards has revealed internal guidelines that allowed the company’s chatbots to have interactions with children, generate racially demeaning content, and produce false medical information if a disclaimer was included.

See:  Tragic Incident Highlights AI Chatbot Risks for Teens

The 200-plus page policy called, "GenAI: Content Risk Standards", applied to chatbots across Facebook, Instagram, and WhatsApp.  Meta confirmed the document was authentic and said some sections have now been removed. Meta described the controversial examples as “erroneous and inconsistent” with its policies, but admitted its enforcement was inconsistent.

Reuters reviewed internal policy materials that included Meta chatbot guideline examples related to children and examples related to race. These outlined scenarios the company considered acceptable and unacceptable under its AI behaviour standards.

Lawmakers Push for Investigation and New Rules

The leaked rules have triggered a bipartisan backlash in Washington. As reported by Reuters on the U.S. Senate response, Republican senators Josh Hawley and Marsha Blackburn have called on congress to investigate, linking the AI ethics gap to the Kids Online Safety Act (KOSA). The bill would require platforms to take stronger measures to protect minors.  Democratic senators Ron Wyden and Peter Welch also condemned the policies.  Wyden argued that Section 230 protections for online platforms should not apply to generative AI chatbots.  Welch said the findings show the urgent need for enforceable AI safeguards.

Why This Matters for Canada’s AI Sector

Canada introduced a Voluntary Code of Conduct for generative AI in September 2023 that includes commitments to safety testing, fairness, transparency, human oversight, and privacy protection. These commitments aim to prevent the kind of harm seen in Meta’s internal examples, but the code isn't legally binding, and no AI specific enforcement exists until the proposed Artificial Intelligence and Data Act is passed.  So until then, it means that AI guardrails in Canada is largely up to companies to self police and public pressure, unless existing laws such as the Criminal Code or hate speech provisions are triggered.

Conclusion

Unchecked AI rules can allow GenAI outputs that many see as ethically unacceptable. Canadian fintechs, AI developers, and digital platforms should build stronger, enforceable guardrails before regulators step in.

See:  NIST Insights: GenAI Risk Management Framework

With the U.S. now advancing legislation like KOSA, Canadian companies could soon face a higher ethics bar at home and abroad.


NCFA Jan 2018 resizeThe National Crowdfunding & Fintech Association (NCFA Canada) is a financial innovation ecosystem that provides education, market intelligence, industry stewardship, networking and funding opportunities and services to thousands of community members and works closely with industry, government, partners and affiliates to create a vibrant and innovative fintech and funding industry in Canada. Decentralized and distributed, NCFA is engaged with global stakeholders and helps incubate projects and investment in fintech, alternative finance, crowdfunding, peer-to-peer finance, payments, digital assets and tokens, artificial intelligence, blockchain, cryptocurrency, regtech, and insurtech sectors. Join Canada's Fintech & Funding Community today FREE! Or become a contributing member and get perks. For more information, please visit: www.ncfacanada.org

NCFA Financial Innovation MapNCFA Innovation Opportunity BriefsNCFA Fintech Insights
NCFA Fintech WhispererNCFA Fintech Fridays PodcastNCFA Weekly Newsletter

 

Leave a Reply

Your email address will not be published. Required fields are marked *