AI Governance for Product & Design folks

Essay by Will Dzierson · May 30, 2025

AI interfaces being rapidly adopted across industries only serves to highlight the need for thoughtful AI governance. (The use of a hyper-realistic AI avatar in a courtroom recently emphasized both the potential and the actual ethical complexities of AI across numerous contexts -- my previous post addressed this briefly).

By the book: AI Governance refers to the structured set of policies, frameworks, processes, and oversight mechanisms designed to ensure that AI systems are developed and used responsibly, ethically, and transparently. It encompasses addressing potential risks, safeguarding user rights, aligning AI behaviors with societal values, and ensuring accountability throughout the lifecycle of AI technologies.

Some practical guidelines for companies (and design/product teams) integrating AI into their product offerings include:

  • Transparency: Clearly indicate when users are interacting with AI to build trust and prevent unintended manipulation. Let's trust, yet verify. And then verify again. (And again.)
  • Diverse Expertise: Engage cross-functional teams -- including ethicists, psychologists, UX designers, and technologists -- to thoroughly understand and address ethical considerations. The concept of "UX" is only expanding discipline-wise.
  • User Agency: Provide users with clear options to manage their interactions with AI, especially in emotionally or ethically sensitive scenarios. This might involve transferring to an actual human to complete a task, or reverting to a completely non-AI enabled experience.
  • Continuous Evaluation: Regularly assess and refine AI experiences based on user feedback and evolving ethical standards to ensure ongoing alignment with human values.

If you're new to AI governance (alongside most of the world), here's something of a kickstarter to enhance your own understanding, and to perhaps share around your organization a bit more broadly:

Starting Points:

Books:

  • "AI Ethics: A Textbook" by Mark Coeckelbergh
  • "Human Compatible: Artificial Intelligence and the Problem of Control" by Stuart Russell
  • "Weapons of Math Destruction" by Cathy O'Neil
  • "AI Fairness: Designing Equal Opportunity Algorithms" by Derek Leben

Online Resources:

  • AI Ethics Guidelines by the European Commission
  • AI Now Institute Reports

Intermediate Learning:

Courses:

  • "Ethics of AI" by the University of Helsinki
  • "AI for Everyone" by Andrew Ng on Coursera

Podcasts:

  • "The AI Alignment Podcast" by Lucas Perry
  • "AI Today Podcast" by Cognilytica

Advanced Exploration:

Research & Papers:

  • "Artificial Intelligence and Life in 2030" (Stanford's One Hundred Year Study on Artificial Intelligence)

Events & Workshops:

  • AI ethics and governance panels at conferences such as NeurIPS, AAAI, or SXSW
  • Workshops by organizations like The Alan Turing Institute

Effective governance strategies not only safeguard user interests but also position businesses to responsibly harness AI’s transformative potential.