Revealed: The dangers of HR using AI

A new study has revealed how deeply ingrained stereotypes can be perpetuated by AI, impacting recruitment, pay equity, and career aspirations.

Prompts for CEO’s, doctors, engineers, carpenters, electricians, manufacturing workers, and salespeople produced exclusively male results. Meanwhile, images of women were entirely generated when inputting the job titles of housekeeper, HR manager, marketing assistant, receptionist, and nurse. The only job that AI programmes repeatedly generated both men and women for was a teacher. However, when asked to produce content about a headteacher, the outputs reverted to including men only.

The study* found that it’s not just harmful gender stereotypes AI is conforming to. In the same study, race and age were clearly considered when generating both images and text. When CEOs were generated, they were exclusively white, middle-aged men, whereas young white women were generated under the job title of marketing assistant. Looking at deskless industries, manufacturing workers were generated solely as young men of colour, and housekeepers were all young women, some mixed race.

Chris Brown, CEO  at Rippl says, “AI can be a great tool when it is set up correctly and teams are trained in its proper use. However, we also know AI is susceptible to bias, and this study demonstrates just how widespread this problem is when it comes to workplace stereotypes.

“The impact these enduring biases can have in the workplace is huge. If AI is used to screen CV’s or identify potential candidates, its bias can lead to qualified individuals, particularly women and minorities, being overlooked. This can perpetuate existing pay inequities, where women and minorities are often paid less for the same work. Studies have also shown that stereotyping is still having an impact on children’s career aspirations.

“While AI undeniably has its use in the workplace in supporting and streamlining working processes, this experiment is a stark reminder of its limitations. Its inherent bias and lack of regulation means it simply cannot be a replacement for humans – and people practices must remain human-led to ensure all talent is accurately represented, seen and heard, and celebrated for their contribution.”

*Rippl

    Read more

    Latest News

    Read More

    How HR can fix the credibility deficit

    22 November 2024

    Newsletter

    Receive the latest HR news and strategic content

    Please note, as per the GDPR Legislation, we need to ensure you are ‘Opted In’ to receive updates from ‘theHRDIRECTOR’. We will NEVER sell, rent, share or give away your data to third parties. We only use it to send information about our products and updates within the HR space To see our Privacy Policy – click here

    Latest HR Jobs

    University of Oxford – Nuffield Department of MedicineSalary: £27,838 to £31,459 per annum (pro rata). This is inclusive of a pensionable Oxford University Weighting of

    JOB TITLE: Hotel Manager – FTC 12 months – January 2025 start LOCATION; North West England SALARY: Around £45,000 per year plus performance-based bonus, rewards,

    We are seeking a dynamic and driven Human Resources Officer to become a key player in The Welbeck Team In this exciting role, you’ll invent

    Read the latest digital issue of theHRDIRECTOR for FREE

    Read the latest digital issue of theHRDIRECTOR for FREE